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Preface 


From the beginning of the 1980s we have witnessed a revolution in 
computer technology and an explosion in user-friendly applications. This 
revolution is still continuing today with low-cost personal computer 
systems that rival the performance of expensive workstations. This tech- 
nological prowess should be brought to bear on the educational process 
and, in particular, on effective teaching that can result in enhanced learn- 
ing. This companion book on digital signal processing (DSP) makes a 
small contribution toward reaching that goal. 

The teaching methods in signal processing have changed over the 
years from the simple “lecture-only” format to a more integrated “lecture- 
laboratory” environment in which practical hands-on issues are taught 
using DSP hardware. However, for effective teaching of DSP the lecture 
component must also make extensive use of computer-based explanations, 
examples, and exercises. For the past several years, the MATLAB soft- 
ware developed by The MathWorks, Inc. has established itself as the de 
facto standard for numerical computation in the signal-processing com- 
munity and as a platform of choice for algorithm development. There are 
several reasons for this development, but the most important reason is 
that MATLAB is available on practically all-computing platforms. In this 
book we have made an attempt at integrating MATLAB with traditional 
topics in DSP so that it can be used to explore difficult topics and solve 
problems to gain insight. Many problems or design algorithms in DSP 
require considerable computation. It is for these that MATLAB provides 
a convenient tool so that many scenarios can be tried with ease. Such an 
approach can enhance the learning process. 


xi 
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xii PREFACE 


SCOPE OF THE BOOK 
— g~ 


This book is primarily intended for use as a supplement in junior- or 
senior-level undergraduate courses on DSP. Although we assume that the 
student (or user) is familiar with the fundamentals of MATLAB, we have 
provided a brief introduction to MATLAB in Chapter 1. Also, this book 
is not written as a textbook in DSP because of the availability of excellent 
textbooks. What we have tried to do is to provide enough depth to the 
material augmented by MATLAB functions and examples so that the 
presentation is consistent, logical, and enjoyable. Therefore, this book 
can also be used as a self-study guide by anyone interested in DSP. 


ORGANIZATION OF THE BOOK 
— g 


The first ten chapters of this book discuss traditional material typically 
covered in an introductory course on DSP. The final two chapters are 
presented as applications in DSP with emphasis on MATLAB-based 
projects. The following is a list of chapters and a brief description of their 
contents. 


Chapter 1, Introduction: This chapter introduces readers to the discipline 
of signal processing and presents several applications of digital signal 
processing, including musical sound processing, echo generation, echo 
removal, and digital reverberation. A brief introduction to MATLAB 
is also provided. 

Chapter 2, Discrete-time Signals and Systems: This chapter provides a 
brief review of discrete-time signals and systems in the time domain. 
Appropriate use of MATLAB functions is demonstrated. 


Chapter 3, The Discrete-time Fourier Analysis: This chapter discusses 
discrete-time signal and system representation in the frequency domain. 
Sampling and reconstruction of analog signals are also presented. 

Chapter 4, The z-Transform: This chapter provides signal and system 
description in the complex frequency domain. MATLAB techniques 
are introduced to analyze z-transforms and to compute inverse z- 
transforms. Solutions of difference equations using the z-transform and 
MATLAB are provided. 


Chapter 5, The Discrete Fourier Transform: This chapter is devoted 
to the computation of the Fourier transform and to its efficient 
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PREFACE xiii 


implementation. The discrete Fourier series is used to introduce the 
discrete Fourier transform, and several of its properties are demon- 
strated using MATLAB. Topics such as fast convolution and fast 
Fourier transform are thoroughly discussed. 

Chapter 6, Implementation of Discrete-Time Filters: This chapter dis- 
cusses several structures for the implementation of digital filters. 
Several useful MATLAB functions are developed for the determination 
and implementation of these structures. Lattice and ladder filters are 
also introduced and discussed. In addition to considering various fil- 
ter structures, we also treat quantization effects when finite-precision 
arithmetic is used in the implementation of IIR and FIR filters. 

Chapter 7, FIR Filter Design: This chapter and the next introduce the im- 
portant topic of digital filer design. Three important design techniques 
for FIR filters-namely, window design, frequency sampling design, and 
the equiripple filer design—are discussed. Several design examples are 
provided using MATLAB. 

Chapter 8, IIR Filter Design: Included in this chapter are techniques used 
in IIR filter design. The chapter begins with the treatment of some 
basic filter types, namely, digital resonators, notch filters, comb filters, 
all-pass filters, and digital sinusoidal oscillators. This is followed by 
a brief description of the characteristics of three widely used analog 
filters. Transformations are described for converting these prototype 
analog filters into different frequency-selective digital filters. The chap- 
ter concludes with several IIR filter designs using MATLAB. 

Chapter 9, Sampling Rate Conversion: This chapter teats the important 
problem of sampling rate conversion in digital signal processing. Top- 
ics treated include decimation and interpolation by integer factors, 
sampling rate conversion by rational factor, and filter structures for 
sampling rate conversion. 

Chapter 10, Round-off Effects in Digital Filters: The focus of this chapter 
is on the effects of finite-precision arithmetic to the filtering aspects 
in signal processing. Quantization noise introduced in analog-to-digital 
conversion is characterized statistically and the quantization effects in 
finite precision multiplication and additions are also modeled statisti- 
cally. The effects of these errors in the filter output are characterized as 
correlated errors, called limit cycles and as uncorrelated errors, called 
round-off noise. 

Chapter 11, Applications in Adaptive Filtering: This chapter is the first 
of two chapters on projects using MATLAB. Included is an introduc- 
tion to the theory and implementation of adaptive FIR filters with 
projects in system identification, interference suppression, narrowband 
frequency enhancement, and adaptive equalization. 
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Chapter 12, Applications in Communications: This chapter focuses on 
several projects dealing with waveform representation and coding 
and with digital communications. Included is a description of pulse- 
code modulation (PCM), differential PCM (DPCM) and adaptive 
DPCM (ADPCM), delta modulation (DM) and adaptive DM (ADM), 
linear predictive coding (LPC), generation and detection of dual- 
tone multifrequency (DTMF) signals, and a description of signal de- 
tection applications in binary communications and spread-spectrum 
communications. 


ABOUT THE SOFTWARE 
———Y__- 


The book is an outgrowth of our teaching of a MATLAB-based under- 
graduate DSP course over several years. Most of the MATLAB functions 
discussed in this book were developed in this course. These functions are 
collected in the book toolbox called DSPUM and are available online 
on the book’s companion website. Many examples in the book contain 
MATLAB scripts. Similarly, MATLAB plots were created using scripts. 
All these scripts are made available at the companion website for the bene- 
fit of students and instructors. Students should study these scripts to gain 
insight into MATLAB procedures. We will appreciate any comments, cor- 
rections, or compact coding of these functions and scripts. Solutions to 
problems and the associated script files will be made available to instruc- 
tors adopting the book through the companion website. To access the 
book’s companion website and all additional course materials, please visit 
www.cengagebrain.com. At the CengageBrain.com home page, search for 
the ISBN of your title (from the back cover of your book) using the search 
box at the top of the page. This will take you to the product page where 
these resources can be found. 

Further information about MATLAB and related publications may 
be obtained from 


The MathWorks, Inc. 

24 Prime Park Way 

Natick, MA 01760-1500 

Phone: (508) 647-7000 Fax: (508) 647-7001 
E-mail: info@mathworks.com 

WWW: http://www.mathworks.com 
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CHAPTER 


Introduction 


During the past several decades the field of digital signal processing (DSP) 
has grown to be important, both theoretically and technologically. A ma- 
jor reason for its success in industry is the development and use of low-cost 
software and hardware. New technologies and applications in various fields 
are now taking advantage of DSP algorithms. This will lead to a greater 
demand for electrical and computer engineers with background in DSP. 
Therefore, it is necessary to make DSP an integral part of any electrical 
engineering curriculum. 

Two decades ago an introductory course on DSP was given mainly at 
the graduate level. It was supplemented by computer exercises on filter 
design, spectrum estimation, and related topics using mainframe (or mini) 
computers. However, considerable advances in personal computers and 
software during the past two decades have made it necessary to introduce 
a DSP course to undergraduates. Since DSP applications are primarily 
algorithms that are implemented either on a DSP processor [11] or in 
software, a fair amount of programming is required. Using interactive 
software, such as MATLAB, it is now possible to place more emphasis 
on learning new and difficult concepts than on programming algorithms. 
Interesting practical examples can be discussed, and useful problems can 
be explored. 

With this philosophy in mind, we have developed this book as a com- 
panion book (to traditional textbooks like [18, 23]) in which MATLAB is 
an integral part in the discussion of topics and concepts. We have chosen 
MATLAB as the programming tool primarily because of its wide avail- 
ability on computing platforms in many universities across the world. 
Furthermore, a low-cost student version of MATLAB has been available 
for several years, placing it among the least expensive software products 
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2 Chapter 1 mi INTRODUCTION 


for educational purposes. We have treated MATLAB as a computational 
and programming toolbox containing several tools (sort of a super calcu- 
lator with several keys) that can be used to explore and solve problems 
and, thereby, enhance the learning process. 

This book is written at an introductory level in order to introduce 
undergraduate students to an exciting and practical field of DSP. We 
emphasize that this is not a textbook in the traditional sense but a com- 
panion book in which more attention is given to problem solving and 
hands-on experience with MATLAB. Similarly, it is not a tutorial book in 
MATLAB. We assume that the student is familiar with MATLAB and is 
currently taking a course in DSP. The book provides basic analytical tools 
needed to process real-world signals (a.k.a. analog signals) using digital 
techniques. We deal mostly with discrete-time signals and systems, which 
are analyzed in both the time and the frequency domains. The analysis 
and design of processing structures called filters and spectrum analyzers 
are among of the most important aspects of DSP and are treated in great 
detail in this book. Two important topics on finite word-length effects and 
sampling-rate conversion are also discussed in this book. More advanced 
topics in modern signal processing like statistical and adaptive signal pro- 
cessing are generally covered in a graduate course. These are not treated 
in this book, but it is hoped that the experience gained in using this book 
will allow students to tackle advanced topics with greater ease and un- 
derstanding. In this chapter we provide a brief overview of both DSP and 
MATLAB. 


1.1 OVERVIEW OF DIGITAL SIGNAL PROCESSING 
SS eee eee 


In this modern world we are surrounded by all kinds of signals in vari- 
ous forms. Some of the signals are natural, but most of the signals are 
manmade. Some signals are necessary (speech), some are pleasant (mu- 
sic), while many are unwanted or unnecessary in a given situation. In an 
engineering context, signals are carriers of information, both useful and 
unwanted. Therefore extracting or enhancing the useful information from 
a mix of conflicting information is the simplest form of signal processing. 
More generally, signal processing is an operation designed for extracting, 
enhancing, storing, and transmitting useful information. The distinction 
between useful and unwanted information is often subjective as well as 
objective. Hence signal processing tends to be application dependent. 


1.1.1 HOW ARE SIGNALS PROCESSED? 
The signals that we encounter in practice are mostly analog signals. These 
signals, which vary continuously in time and amplitude, are processed 
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Overview of Digital Signal Processing 3 


using electrical networks containing active and passive circuit elements. 
This approach is known as analog signal processing (ASP)—for example, 
radio and television receivers. 


Analog signal: £a(t) — | Analog signal processor | —> y(t) :Analog signal 


They can also be processed using digital hardware containing adders, 
multipliers, and logic elements or using special-purpose microprocessors. 
However, one needs to convert analog signals into a form suitable for 
digital hardware. This form of the signal is called a digital signal. It takes 
one of the finite number of values at specific instances in time, and hence 
it can be represented by binary numbers, or bits. The processing of digital 
signals is called DSP; in block diagram form it is represented by 


Equivalent Analog Signal Processor 
—_ ee .)..20000 De 
digital digital 
Analog >| — | PrF | — | ADC | — | DSP | — | DAC | — | PoF | > |—> Analog 


Discrete System 


The various block elements are discussed as follows. 


PrF: This is a prefilter or an antialiasing filter, which conditions the analog 
signal to prevent aliasing. 

Abc: This is an analog-to-digital converter, which produces a stream of 
binary numbers from analog signals. 

Digital Signal Processor: This is the heart of DSP and can represent a general- 
purpose computer or a special-purpose processor, or digital hardware, 
and so on. 

DAC: This is the inverse operation to the ADC, called a digital-to-analog 
converter, which produces a staircase waveform from a sequence of 
binary numbers, a first step toward producing an analog signal. 

PoF: This is a postfilter to smooth out staircase waveform into the desired 
analog signal. 


It appears from the above two approaches to signal processing, analog 
and digital, that the DSP approach is the more complicated, containing 
more components than the “simpler looking” ASP. Therefore one might 
ask, Why process signals digitally? The answer lies in the many advan- 
tages offered by DSP. 


1.1.2 ADVANTAGES OF DSP OVER ASP 

A major drawback of ASP is its limited scope for performing complicated 
signal-processing applications. This translates into nonflexibility in pro- 
cessing and complexity in system designs. All of these generally lead to 
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expensive products. On the other hand, using a DSP approach, it is pos- 
sible to convert an inexpensive personal computer into a powerful signal 
processor. Some important advantages of DSP are these: 


1. Systems using the DSP approach can be developed using software run- 
ning on a general-purpose computer. Therefore DSP is relatively con- 
venient to develop and test, and the software is portable. 

2. DSP operations are based solely on additions and multiplications, lead- 
ing to extremely stable processing capability—for example, stability 
independent of temperature. 

3. DSP operations can easily be modified in real time, often by simple 
programming changes, or by reloading of registers. 

4. DSP has lower cost due to VLSI technology, which reduces costs of 
memories, gates, microprocessors, and so forth. 


The principal disadvantage of DSP is the limited speed of operations 
limited by the DSP hardware, especially at very high frequencies. Primar- 
ily because of its advantages, DSP is now becoming a first choice in many 
technologies and applications, such as consumer electronics, communica- 
tions, wireless telephones, and medical imaging. 


1.1.3 TWO IMPORTANT CATEGORIES OF DSP 
Most DSP operations can be categorized as being either signal analysis 
tasks or signal filtering tasks: 


Digital Signal 
, Analysis ; Digital Filter 
Measurements Digital Signal 


Signal analysis This task deals with the measurement of signal prop- 
erties. It is generally a frequency-domain operation. Some of its applica- 
tions are 


spectrum (frequency and/or phase) analysis 
speech recognition 

speaker verification 

target detection 


Signal filtering This task is characterized by the signal-in signal-out 
situation. The systems that perform this task are generally called filters. 
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It is usually (but not always) a time-domain operation. Some of the ap- 
plications are 


removal of unwanted background noise 
removal of interference 

separation of frequency bands 

shaping of the signal spectrum 


In some applications, such as voice synthesis, a signal is first analyzed 
to study its characteristics, which are then used in digital filtering to 
generate a synthetic voice. 


1.2 A BRIEF INTRODUCTION TO MATLAB 
—— g 


MATLAB is an interactive, matrix-based system for scientific and engi- 
neering numeric computation and visualization. Its strength lies in the fact 
that complex numerical problems can be solved easily and in a fraction 
of the time required by a programming language such as Fortran or C. It 
is also powerful in the sense that, with its relatively simple programming 
capability, MATLAB can be easily extended to create new commands and 
functions. 

MATLAB is available in a number of computing environments: PCs 
running all flavors of Windows, Apple Macs running OS-X, UNIX/Linux 
workstations, and parallel computers. The basic MATLAB program is 
further enhanced by the availability of numerous toolboxes (a collection 
of specialized functions in a specific topic) over the years. The information 
in this book generally applies to all these environments. In addition to the 
basic MATLAB product, the Signal Processing toolbox (SP toolbox) is 
required for this book. The original development of the book was done us- 
ing the professional version 3.5 running under DOS. The MATLAB scripts 
and functions described in the book were later extended and made com- 
patible with the present version of MATLAB. Furthermore, through the 
services of www.cengagebrain.com every effort will be made to preserve 
this compatibility under future versions of MATLAB. 

In this section, we will undertake a brief review of MATLAB. The 
scope and power of MATLAB go far beyond the few topics discussed 
in this section. For more detailed tutorial-based discussion, students and 
readers new to MATLAB should also consult several excellent reference 
books available in the literature, including [10], [7], and [21]. The informa- 
tion given in all these references, along with the online MATLAB’s help 
facility, usually is sufficient to enable readers to use this book. The best ap- 
proach to become familiar with MATLAB is to open a MATLAB session 
and experiment with various operators, functions, and commands until 
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their use and capabilities are understood. Then one can progress to writ- 
ing simple MATLAB scripts and functions to execute a sequence of in- 
structions to accomplish an analytical goal. 


1.2.1 GETTING STARTED 

The interaction with MATLAB is through the command window of its 
graphical user interface (GUI). In the command window, the user types 
MATLAB instructions, which are executed instantaneously, and the re- 
sults are displayed in the window. In the MATLAB command window the 
characters “>>” indicate the prompt which is waiting for the user to type 
a command to be executed. For example, 


>> command; 


means an instruction command has been issued at the MATLAB prompt. 
If a semicolon (;) is placed at the end of a command, then all output 
from that command is suppressed. Multiple commands can be placed on 
the same line, separated by semicolons ;. Comments are marked by the 
percent sign (%), in which case MATLAB ignores anything to the right 
of the sign. The comments allow the reader to follow code more easily. 
The integrated help manual provides help for every command through the 
fragment 


>> help command; 


which will provide information on the inputs, outputs, usage, and func- 
tionality of the command. A complete listing of commands sorted by 
functionality can be obtained by typing help at the prompt. 

There are three basic elements in MATLAB: numbers, variables, and 
operators. In addition, punctuation marks (,, ;, :, etc.) have special 
meanings. 


Numbers MATLAB is a high-precision numerical engine and can han- 
dle all types of numbers, that is, integers, real numbers, complex numbers, 
among others, with relative ease. For example, the real number 1.23 is rep- 
resented as simply 1.23 while the real number 4.56 x 10” can be written 
as 4.56e7. The imaginary number y—I is denoted either by 1i or 1j, 
although in this book we will use the symbol 1j. Hence the complex num- 
ber whose real part is 5 and whose imaginary part is 3 will be written as 
5+1j*3. Other constants preassigned by MATLAB are pi for 7, inf for 
oo, and NaN for not a number (for example, 0/0). These preassigned con- 
stants are very important and, to avoid confusion, should not be redefined 
by users. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


A Brief Introduction to MATLAB 7 


Variables In MATLAB, which stands for MATrix LABoratory, the ba- 
sic variable is a matrix, or an array. Hence, when MATLAB operates on 
this variable, it operates on all its elements. This is what makes it a pow- 
erful and an efficient engine. MATLAB now supports multidimensional 
arrays; we will discuss only up to two-dimensional arrays of numbers. 


1. Matrix: A matrix is a two-dimensional set of numbers arranged in 
rows and columns. Numbers can be real- or complex-valued. 

2. Array: This is another name for matrix. However, operations on arrays 
are treated differently from those on matrices. This difference is very 
important in implementation. 


The following are four types of matrices (or arrays): 


e Scalar: This is a 1 x 1 matrix or a single number that is denoted by 
the variable symbol, that is, lowercase italic typeface like 


a= Q11 


e Column vector: This is an (N x 1) matrix or a vertical arrangement 
of numbers. It is denoted by the vector symbol, that is, lowercase bold 
typeface like 


TNI 


A typical vector in linear algebra is denoted by the column vector. 
e Row vector: This is a (1 x M) matrix or a horizontal arrangement of 
numbers. It is also denoted by the vector symbol, that is, 


\ a luij]... = [vit yiz = yım] 


A one-dimensional discrete-time signal is typically represented by an 
array as a row vector. 

e General matrix: This is the most general case of an (N x M) matrix 
and is denoted by the matrix symbol, that is, uppercase bold typeface 


like 
Q11 Q12 *** QIM 
Q21 Q22 *** Q2M 
A= laili... Nij=1,.. m = 
QN1 4N2°** ANM 


This arrangement is typically used for two-dimensional discrete-time 
signals or images. 
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MATLAB does not distinguish between an array and a matrix except for 
operations. The following assignments denote indicated matrix types in 
MATLAB: 


[3] is a scalar, 

[1,2,3] is a row vector, 

= [1;2;3] is a column vector, and 
[1,2,3;4,5,6] is a matrix. 


>< 6 
I 


MATLAB provides many useful functions to create special matrices. 
These include zeros (M,N) for creating a matrix of all zeros, ones (M,N) 
for creating matrix of all ones, eye(N) for creating an N x N identity 
matrix, etc. Consult MATLAB’s help manual for a complete list. 


Operators MATLAB provides several arithmetic and logical operators, 
some of which follow. For a complete list, MATLAB’s help manual should 
be consulted. 


= assignment == equality 
+ addition - subtraction or minus 
* multiplication .* array multiplication 
^ power .^ array power 
/ division / array division 
<> relational operators & logical AND 
| logical OR ~ logical NOT 
> transpose .? array transpose 


We now provide a more detailed explanation on some of these operators. 


1.2.2 MATRIX OPERATIONS 
Following are the most useful and important operations on matrices. 


e Matrix addition and subtraction: These are straightforward oper- 
ations that are also used for array addition and subtraction. Care must 
be taken that the two matrix operands be exactly the same size. 
e Matrix conjugation: This operation is meaningful only for complex- 
valued matrices. It produces a matrix in which all imaginary parts are 
negated. It is denoted by A* in analysis and by conj(A) in MATLAB. 
e Matrix transposition: This is an operation in which every row (col- 
umn) is turned into column (row). Let X be an (N x M) matrix. Then 


1 


X = [zji]; 9S Tyg My tS Diy N. 


is an (M x N) matrix. In MATLAB, this operation has one additional 
feature. If the matrix is real-valued, then the operation produces the 
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usual transposition. However, if the matrix is complex-valued, then the 
operation produces a complex-conjugate transposition. To obtain just 
the transposition, we use the array operation of conjugation, that is, 
A.’ will do just the transposition. 

e Multiplication by a scalar: This is a simple straightforward 
operation in which each element of a matrix is scaled by a constant, 
that is, 


ab = a*b (scalar) 
ax = a*x (vector or array) 
aX => a*X (matrix) 


This operation is also valid for an array scaling by a constant. 

e Vector-vector multiplication: In this operation, one has to be care- 
ful about matrix dimensions to avoid invalid results. The operation 
produces either a scalar or a matrix. Let x be an (N x 1) and y bea 
(1 x M) vectors. Then 


Tı T1Y1 vs T1YM 


TN TINY rion TNYM 


Tı 
y*x>yx= [un = ym] | | | = t+-:-+2uyu 


TM 


e Matrix-vector multiplication: If the matrix and the vector are com- 
patible (i.e., the number of matrix-columns is equal to the vector-rows), 
then this operation produces a column vector: 


a11 pis QIM Tı yı 
y = Atx>y=Ax=| : Si : es 


ani in anM TM YN 


e Matrix-matrix multiplication: Finally, if two matrices are compat- 
ible, then their product is well-defined. The result is also a matrix with 
the number of rows equal to that of the first matrix and the number 
of columns equal to that of the second matrix. Note that the order in 
matrix multiplication is very important. 
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Array Operations These operations treat matrices as arrays. They 
are also known as dot operations because the arithmetic operators are 
prefixed by a dot (.), that is, .*, ./, or .^. 


e Array multiplication: This is an element by element multiplication 
operation. For it to be a valid operation, both arrays must be the same 


size. Thus we have 
x.*y — 1D array 


X.*Y — 2D array 


e Array exponentiation: In this operation, a scalar (real- or complex- 
valued) is raised to the power equal to every element in an array, that is, 


a 
a”? 
a.^x = 
Qn 
is an (N x 1) array, whereas 
q™ a712 ias a%ıM 
a221 a822 ... qt2M 
a. ^X = 
qQrNnt qt N2 aie qQuNM 


is an (N x M) array. 
e Array transposition: As explained, the operation A.’ produces trans- 
position of real- or complex-valued array A. 


Indexing Operations MATLAB provides very useful and powerful ar- 
ray indexing operations using operator :. It can be used to generate se- 
quences of numbers as well as to access certain row/column elements of a 
matrix. Using the fragment x = [a:b:c], we can generate numbers from 
a to c in b increments. If b is positive (negative) then, we get increasing 
(decreasing) values in the sequence x. 

The fragment x(a:b:c) accesses elements of x beginning with index 
a in steps of b and ending at c. Care must be taken to use integer values 
of indexing elements. Similarly, the : operator can be used to extract a 
submatrix from a matrix. For example, B = A(2:4,3:6) extractsa3 x4 
submatrix starting at row 2 and column 3. 

Another use of the : operator is in forming column vectors from row 
vectors or matrices. When used on the right-hand side of the equality (=) 
operator, the fragment x=A(:) forms a long column vector x of elements 
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of A by concatenating its columns. Similarly, x=A(:,3) forms a vector x 
from the third column of A. However, when used on the right-hand side 
of the = operator, the fragment A(:)=x reformats elements in x into a 
predefined size of A. 


Control-Flow MATLAB provides a variety of commands that allow 
us to control the flow of commands in a program. The most common 
construct is the if-elseif-else structure. With these commands, we can 
allow different blocks of code to be executed depending on some condition. 
The format of this construct is 


if conditioni 
command1 
elseif condition2 
command2 
else 
command3 
end 


which executes statements in command! if condition-1 is satisfied; other- 
wise statements in command2 if condition-2 is satisfied, or finally state- 
ments in command3. 

Another common control flow construct is the for..end loop. It is 
simply an iteration loop that tells the computer to repeat some task a 
given number of times. The format of a for. .end loop is 


for index = values 
program statements 


end 


Although for. .end loops are useful for processing data inside of arrays by 
using the iteration variable as an index into the array, whenever possible 
the user should try to use MATLAB’s whole array mathematics. This will 
result in shorter programs and more efficient code. In some situations the 
use of the for. .end loop is unavoidable. The following example illustrates 
these concepts. 


EXAMPLE 1.1 Consider the following sum of sinusoidal functions. 


1 


z sin(2rkt), 0<t<1 


3 
a(t) = sin(2rt) + $ sin(6rt) + $ sin(10rt) = 5o zs 
k=1 


Using MATLAB, we want to generate samples of x(t) at time instances 
0:0.01:1. We will discuss three approaches. 
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Approach 1 Here we will consider a typical C or Fortran approach, that is, we will use two 
for..end loops, one each on t and k. This is the most inefficient approach in 
MATLAB, but possible. 


>> t = 0:0.01:1; N = length(t); xt = zeros(1,N); 
>> for n = 1:N 


>> temp = 0; 
>> for k = 1:3 
>> temp = temp + (1/k)*sin(2*pi*k*t (n)) ; 
>> end 
>> xt(n) = temp; 
>> end 
Approach 2 In this approach, we will compute each sinusoidal component in one step as a 


vector, using the time vector t = 0:0.01:1 and then add all components using 
one for. .end loop. 


>> t = 0:0.01:1; xt = zeros(1,length(t)); 
>> for k = 1:3 

>> xt = xt + (1/k)*sin(2*pi*k+t) ; 

>> end 


Clearly, this is a better approach with fewer lines of code than the first one. 


Approach 3 In this approach, we will use matrix-vector multiplication, in which MATLAB 
is very efficient. For the purpose of demonstration, consider only four values for 
t = [t1, t2, t3, ta]. Then 


(ti) = sin(2rt,) + $ sin(2r3t1) + + sin(2r5ty 


a(t2) = sin(2rtz) + 3 sin(273t2) + + sin(2r5t2 


a(t3) = sin(2rt3) + 4 sin(273t3) + 4 sin(2r5ts 


a(ta) = sin(2mta) + 4 sin(273t4) + $ sin(2r5t4 


which can be written in matrix form as 


z(t) sin(27t1) sin(273t1) sin(2r5t1) 

1 
x(t2) sin(2mt2) sin(2m3t2) sin(2r5t2)| | | 
a(ts)} sin(27t3) sin(273t3) sin(275t3) i 
x(ta) sin(2mt4) sin(273t4) sin(275t.) ° 

t 

h : 
=sin | 2| | [1 3.5] | [4 

t3 A 

ta : 
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or after taking transposition 


1 

[(ti1) a«(t2) ax(ts) x(ts)] =[1 4 ]sin| 27 |3| [ti t2 ts ta] 
5 

Thus the MATLAB code is 


>> t = 0:0.01:1; k = 1:3; 
>> xt = (1./k)*sin(2*pi*k’ *t) ; 


Note the use of the array division (1./k) to generate a row vector and ma- 
trix multiplications to implement all other operations. This is the most compact 
code and the most efficient execution in MATLAB, especially when the number 
of sinusoidal terms is very large. 


1.2.3 SCRIPTS AND FUNCTIONS 

MATLAB is convenient in the interactive command mode if we want to 
execute few lines of code. But it is not efficient if we want to write code of 
several lines that we want to run repeatedly or if we want to use the code 
in several programs with different variable values. MATLAB provides two 
constructs for this purpose. 


Scripts The first construct can be accomplished by using the so-called 
block mode of operation. In MATLAB, this mode is implemented using 
a script file called an m-file (with an extension .m), which is only a text 
file that contains each line of the file as though you typed them at the 
command prompt. These scripts are created using MATLAB’s built-in 
editor, which also provides for context-sensitive colors and indents for 
making fewer mistakes and for easy reading. The script is executed by 
typing the name of the script at the command prompt. The script file must 
be in the current directory on in the directory of the path environment. 
As an example, consider the sinusoidal function in Example 1.1. A general 


form of this function is 
K 


x(t) = X ck sin(2rkt) (1.1) 
k=1 
If we want to experiment with different values of the coefficients cg and/or 
the number of terms K, then we should create a script file. To implement 
the third approach in Example 1.1, we can write a script file 


% Script file to implement (1.1) 
t =O OnOt disk = 25 ek = 1i; 
xt = ck * sin(2*pi*k’*t) ; 


Now we can experiment with different values. 
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Functions The second construct of creating a block of code is through 
subroutines. These are called functions, which also allow us to extend the 
capabilities of MATLAB. In fact a major portion of MATLAB is assem- 
bled using function files in several categories and using special collections 
called toolboxes. Functions are also m-files (with extension .m). A major 
difference between script and function files is that the first executable 
line in a function file begins with the keyword function followed by an 
output-input variable declaration. As an example, consider the compu- 
tation of the x(t) function in Example 1.1 with an arbitrary number of 
sinusoidal terms, which we will implement as a function stored as m-file 
sinsum.m. 


function xt = sinsum(t,ck) 
% Computes sum of sinusoidal terms of the form in (1.1) 
% x = sinsum(t,ck) 


K = length(ck); k = 1:K; 
ele = Gea) Oe te = wea) s 
xt = ck * sin(2*pi*k’*t) ; 


The vectors t and ck should be assigned prior to using the sinsum 
function. Note that ck(:)’ and t(:)’ use indexing and transposition 
operations to force them to be row vectors. Also note the comments im- 
mediately following the function declaration, which are used by the help 
sinsum command. Sufficient information should be given there for the user 
to understand what the function is supposed to do. 


1.2.4 PLOTTING 

One of the most powerful features of MATLAB for signal and data analysis 
is its graphical data plotting. MATLAB provides several types of plots, 
starting with simple two-dimensional (2D) graphs to complex, higher- 
dimensional plots with full-color capability. We will examine only the 2D 
plotting, which is the plotting of one vector versus another in a 2D coor- 
dinate system. The basic plotting command is the plot (t,x) command, 
which generates a plot of x values versus t values in a separate figure 
window. The arrays t and x should be the same length and orientation. 
Optionally, some additional formatting keywords can also be provided in 
the plot function. The commands xlabel and ylabel are used to add 
text to the axis, and the command title is used to provide a title on 
the top of the graph. When plotting data, one should get into the habit 
of always labeling the axis and providing a title. Almost all aspects of 
a plot (style, size, color, etc.) can be changed by appropriate commands 
embedded in the program or directly through the GUI. 
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The following set of commands creates a list of sample points, eval- 
uates the sine function at those points, and then generates a plot of a 
simple sinusoidal wave, putting axis labels and title on the plot. 


>> t 0:0.01:2; % sample points from 0 to 2 in steps of 0.01 
>> x = sin(2*pixt); % Evaluate sin(2 pi t) 

>> plot(t,x,’b’); % Create plot with blue line 

>> xlabel(’t in sec’); ylabel(’x(t)’); % Label axis 

>> title(’Plot of sin(2\pi t)’); % Title plot 


The resulting plot is shown in Figure 1.1. 

For plotting a set of discrete numbers (or discrete-time signals), we 
will use the stem command which displays data values as a stem, that 
is, a small circle at the end of a line connecting it to the horizontal axis. 
The circle can be open (default) or filled (using the option ’filled’). 
Using Handle Graphics (MATLAB’s extensive manipulation of graphics 
primitives), we can resize circle markers. The following set of commands 
displays a discrete-time sine function using these constructs. 


>> n = 0:1:40; % sample index from 0 to 20 

>> x = sin(0.1*pi*xn); % Evaluate sin(0.2 pi n) 

>> Hs = stem(n,x,’b’,’filled’); % Stem-plot with handle Hs 
>> set(Hs,’markersize’,4); % Change circle size 

>> xlabel(’n’); ylabel(’x(n)’); % Label axis 

>> title(’Stem Plot of sin(0.2 pi n)’); % Title plot 


The resulting plot is shown in Figure 1.2. 

MATLAB provides an ability to display more than one graph in the 
same figure window. By means of the hold on command, several graphs 
can be plotted on the same set of axes. The hold off command stops 
the simultaneous plotting. The following MATLAB fragment (Figure 1.3) 


Plot of sin(2z t) 


0 0.5 1 15 2 
tin sec 


FIGURE 1.1 Plot of the sin(2zt) function 
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Stem Plot of sin(0.2 n n) 
1 r + r r r 
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FIGURE 1.2 Plot of the sin(0.2n n) sequence 


displays graphs in Figures 1.1 and 1.2 as one plot, depicting a “sampling” 
operation that we will study later. 


>> plot(t,xt,’b’); hold on; % Create plot with blue line 
>> Hs = stem(n*0.05,xn,’b’,’filled’); % Stem-plot with handle Hs 
>> set(Hs,’markersize’,4); hold off; % Change circle size 


Another approach is to use the subplot command, which displays 
several graphs in each individual set of axes arranged in a grid, using the 
parameters in the subplot command. The following fragment (Figure 1.4) 
displays graphs in Figure 1.1 and 1.2 as two separate plots in two rows. 


>> subplot(2,1,1); % Two rows, one column, first plot 
>> plot(t,x,’b’); % Create plot with blue line 


>> subplot(2,1,2); % Two rows, one column, second plot 
>> Hs = stem(n,x,’b’,’filled’); % Stem-plot with handle Hs 


Plot of sin(2z t) and its samples 


x(t) and x(n) 


0 0.5 1 1.5 2 
tin sec 


FIGURE 1.3 Simultaneous plots of x(t) and x(n) 
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Plot of sin(2z t) 


x(t) 
Oo 


tin sec 
Stem Plot of sin(0.27 n) 


stall, ih, 
s|| [I ‘| 


x(n) 


FIGURE 1.4 Plots of x(t) and x(n) in two rows 


The plotting environment provided by MATLAB is very rich in 
its complexity and usefulness. It is made even richer using the handle- 
graphics constructs. Therefore, readers are strongly recommended to 
consult MATLAB’s manuals on plotting. Many of these constructs will 
be used throughout this book. 

In this brief review, we have barely made a dent in the enormous 
capabilities and functionalities in MATLAB. Using its basic integrated 
help system, detailed help browser, and tutorials, it is possible to acquire 
sufficient skills in MATLAB in a reasonable amount of time. 


1.3 APPLICATIONS OF DIGITAL SIGNAL PROCESSING 
E 


The field of DSP has matured considerably over the last several decades 
and now is at the core of many diverse applications and products. These 
include 


e speech/audio (speech recognition/synthesis, digital audio, equalization, 
etc.), 

e image/video (enhancement, coding for storage and transmission, 
robotic vision, animation, etc.), 

e military/space (radar processing, secure communication, missile guid- 
ance, sonar processing, etc.), 

e biomedical/health care (scanners, ECG analysis, X-ray analysis, EEG 
brain mappers, etc.) 
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e consumer electronics (cellular/mobile phones, digital television, digital 
camera, Internet voice/music/video, interactive entertainment systems, 
etc) and many more. 


These applications and products require many interconnected com- 
plex steps, such as collection, processing, transmission, analysis, audio/ 
display of real-world information in near real time. DSP technology has 
made it possible to incorporate these steps into devices that are inno- 
vative, affordable, and of high quality (for example, iPhone from Apple, 
Inc.). A typical application to music is now considered as a motivation 
for the study of DSP. 


Musical sound processing In the music industry, almost all musical 
products (songs, albums, etc.) are produced in basically two stages. First, 
the sound from an individual instrument or performer is recorded in an 
acoustically inert studio on a single track of a multitrack recording device. 
Then, stored signals from each track are digitally processed by the sound 
engineer by adding special effects and combined into a stereo recording, 
which is then made available either on a CD or as an audio file. 

The audio effects are artificially generated using various signal- 
processing techniques. These effects include echo generation, reverber- 
ation (concert hall effect), flanging (in which audio playback is slowed 
down by placing DJ’s thumb on the flange of the feed reel), chorus effect 
(when several musicians play the same instrument with small changes 
in amplitudes and delays), and phasing (aka phase shifting, in which 
an audio effect takes advantage of how sound waves interact with each 
other when they are out of phase). These effects are now generated using 
digital-signal-processing techniques. We now discuss a few of these sound 
effects in some detail. 


Echo Generation The most basic of all audio effects is that of time 
delay, or echoes. It is used as the building block of more complicated effects 
such as reverb or flanging. In a listening space such as a room, sound 
waves arriving at our ears consist of direct sound from the source as well 
as reflected off the walls, arriving with different amounts of attenuation 
and delays. 

Echoes are delayed signals, and as such are generated using delay 
units. For example, the combination of the direct sound represented by 
discrete signal y[n] and a single echo appearing D samples later (which is 
related to delay in seconds) can be generated by the equation of the form 
(called a difference equation) 


zin] = yin] +ay[n—D},  laļ<1 (1.2) 
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where x[n] is the resulting signal and a models attenuation of the di- 
rect sound. Difference equations are implemented in MATLAB using the 
filter function. Available in MATLAB is a short snippet of Handel’s 
hallelujah chorus, which is a digital sound about 9 seconds long, sampled 
at 8192 sam/sec. To experience the sound with echo in (1.2), execute 
the following fragment at the command window. The echo is delayed by 
D = 4196 samples, which amount to 0.5 sec of delay. 


load handel; % the signal is in y and sampling freq in Fs 
sound(y,Fs); pause(10); % Play the original sound 

alpha = 0.9; D = 4196; % Echo parameters 

b = [1,zeros(1,D),alpha]; % Filter parameters 

x = filter(b,1,y); % Generate sound plus its echo 
sound(x,Fs); % Play sound with echo 


You should be able to hear the distinct echo of the chorus in about a 
half second. 


Echo Removal After executing this simulation, you may experience 
that the echo is an objectionable interference while listening. Again DSP 
can be used effectively to reduce (almost eliminate) echoes. Such an echo- 
removal system is given by the difference equation 


wjn] + aw[n — D] = zjn] (1.3) 


where x[n] is the echo-corrupted sound signal and w{n] is the output 
sound signal, which has the echo (hopefully) removed. Note again that 
this system is very simple to implement in software or hardware. Now try 
the following MATLAB script on the signal z[n]. 


w = filter(1,b,x); 
sound (w,Fs) 


The echo should no longer be audible. 
Digital Reverberation Multiple close-spaced echoes eventually lead 


to reverberation, which can be created digitally using a somewhat more 
involved difference equation 


N-1 
z[n] = X` ak yn — kD] (1.4) 
k=0 


which generates multiple echoes spaced D samples apart with exponen- 
tially decaying amplitudes. Another natural sounding reverberation is 
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given by 
xin] = ay[n] + y[n — Di) +aa[n—D], lal <1 (1.5) 


which simulates a higher echo density. 

These simple applications are examples of DSP. Using techniques, 
concepts, and MATLAB functions learned in this book you should be 
able to simulate these and other interesting sound effects. 


1.4 BRIEF OVERVIEW OF THE BOOK 
$$ g 


The first part of this book, which comprises Chapters 2 through 5, deals 
with the signal-analysis aspect of DSP. Chapter 2 begins with basic de- 
scriptions of discrete-time signals and systems. These signals and systems 
are analyzed in the frequency domain in Chapter 3. A generalization of 
the frequency-domain description, called the z-transform, is introduced in 
Chapter 4. The practical algorithms for computing the Fourier transform 
are discussed in Chapter 5 in the form of the discrete Fourier transform 
and the fast Fourier transform. 

Chapters 6 through 8 constitute the second part of this book, which is 
devoted to the signal-filtering aspect of DSP. Chapter 6 describes various 
implementations and structures of digital filters. It also introduces finite- 
precision number representation, filter coefficient quantization, and its 
effect on filter performance. Chapter 7 introduces design techniques and 
algorithms for designing one type of digital filter called finite-duration 
impulse response (FIR) filters, and Chapter 8 provides a similar treatment 
for another type of filter called infinite-duration impulse response (IIR) 
filters. In both chapters only the simpler but practically useful techniques 
of filter design are discussed. More advanced techniques are not covered. 

Finally, the last part, which consists of the remaining four chapters, 
provides important topics and applications in DSP. Chapter 9 deals with 
the useful topic of the sampling-rate conversion and applies FIR filter de- 
signs from Chapter 7 to design practical sample-rate converters. Chapter 
10 extends the treatment of finite-precision numerical representation to 
signal quantization and the effect of finite-precision arithmetic on filter 
performance. The last two chapters provide some practical applications 
in the form of projects that can be done using material presented in the 
first 10 chapters. In Chapter 11, concepts in adaptive filtering are intro- 
duced, and simple projects in system identification, interference suppres- 
sion, adaptive line enhancement, and so forth are discussed. In Chapter 12 
a brief introduction to digital communications is presented with projects 
involving such topics as PCM, DPCM, and LPC being outlined. 
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In all these chapters, the central theme is the generous use and ad- 
equate demonstration of MATLAB, which can be used as an effective 
teaching as well as learning tool. Most of the existing MATLAB functions 
for DSP are described in detail, and their correct use is demonstrated in 
many examples. Furthermore, many new MATLAB functions are devel- 
oped to provide insights into the working of many algorithms. The authors 
believe that this hand-holding approach enables students to dispel fears 
about DSP and provides an enriching learning experience. 
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CHAPTER 


Discrete-time 
Signals and 
Systems 


We begin with the concepts of signals and systems in discrete time. A 
number of important types of signals and their operations are introduced. 
Linear and shift-invariant systems are discussed mostly because they are 
easier to analyze and implement. The convolution and the difference equa- 
tion representations are given special attention because of their impor- 
tance in digital signal processing and in MATLAB. The emphasis in this 
chapter is on the representations and implementation of signals and sys- 
tems using MATLAB. 


2.1 DISCRETE-TIME SIGNALS 
—— g 


Signals are broadly classified into analog and discrete signals. An analog 
signal will be denoted by x(t), in which the variable t can represent any 
physical quantity, but we will assume that it represents time in seconds. A 
discrete signal will be denoted by x(n), in which the variable n is integer- 
valued and represents discrete instances in time. Therefore it is also called 
a discrete-time signal, which is a number sequence and will be denoted by 
one of the following notations: 


x(n) = {a(n)} = {... eta) vee 


where the up-arrow indicates the sample at n = 0. 


22 
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In MATLAB we can represent a finite-duration sequence by a row 
vector of appropriate values. However, such a vector does not have any 
information about sample position n. Therefore a correct representation 
of x(n) would require two vectors, one each for x and n. For example, a 
sequence x(n) = {2,1,—1,0,1,4,3,7} can be represented in MATLAB by 

i 


SS WS$3,—2,=1 Oph Aoo43 sel si y=, 1 54.85 3 


Generally, we will use the x-vector representation alone when the sample 
position information is not required or when such information is trivial 
(e.g. when the sequence begins at n = 0). An arbitrary infinite-duration 
sequence cannot be represented in MATLAB due to the finite memory 
limitations. 


2.1.1 TYPES OF SEQUENCES 
We use several elementary sequences in digital signal processing for anal- 
ysis purposes. Their definitions and MATLAB representations follow. 


1. Unit sample sequence: 


1, n=0 


6(n) = a n207 ‘+20,0, 1,0,0,-.. 
In MATLAB the function zeros(1,N) generates a row vector of N 
zeros, which can be used to implement 6(n) over a finite interval. How- 
ever, the logical relation n==0 is an elegant way of implementing 6(n). 
For example, to implement 


1, n=n 


sn —no) = {9 Bam 


over the nı <no<nə interval, we will use the following MATLAB 
function. 


function [x,n] impseq(n0,n1,n2) 

% Generates x(n) = delta(n-n0); ni <= n <= n2 

eee ae We ee ee ee eee eee 
% (x,n] = impseq(n0,n1,n2) 


€V il 


n = [ni:n2]; x = [(m-n0) == 0]; 


2. Unit step sequence: 
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In MATLAB the function ones(1,N) generates a row vector of N ones. 
It can be used to generate u(n) over a finite interval. Once again an 
elegant approach is to use the logical relation n>=0. To implement 


l, n>n 


over the nı <no<nə interval, we will use the following MATLAB 
function. 


function [x,n] stepseq(n0,n1,n2) 

% Generates x(n u(n-n0); ni <= n <= n2 

EEEE ag 
% (x,n] = stepseq(n0,n1,n2) 


~ Il 
I 


n = [ni:n2]; x = [(n-n0) >= 0]; 


3. Real-valued exponential sequence: 
a(n) =a",Vn; a E€ R 


In MATLAB an array operator “.*” is required to implement a real 
exponential sequence. For example, to generate x(n) = (0.9)",0 < 
n < 10, we will need the following MATLAB script: 


>> n = [0:10]; x = (0.9).7n; 


4. Complex-valued exponential sequence: 
a(n) = e(@ tivo) Yn, 


where ø produces an attenuation (if <0) or amplification (if >0) 
and wọ is the frequency in radians. A MATLAB function exp is 
used to generate exponential sequences. For example, to generate 
x(n) =exp|(2 + 73)n],0 <n < 10, we will need the following MATLAB 
script: 


>> n = [0:10]; x = exp((2+3j)*n) ; 


5. Sinusoidal sequence: 
x(n) = Acos(won + bo), Yn 


where A is an amplitude and 09 is the phase in radians. A MAT- 
LAB function cos (or sin) is used to generate sinusoidal sequences. 
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For example, to generate x(n) = 3cos(0.1an + 7/3) + 2sin(0.577n), 
0 <n < 10, we will need the following MATLAB script: 


>> n = [0:10]; x = 3*cos(0.1*pixntpi/3) + 2*sin(0.5*pix*n) ; 


6. Random sequences: Many practical sequences cannot be described 
by mathematical expressions like those above. These sequences are 
called random (or stochastic) sequences and are characterized by pa- 
rameters of the associated probability density functions. In MATLAB 
two types of (pseudo-) random sequences are available. The rand(1,N) 
generates a length N random sequence whose elements are uniformly 
distributed between [0,1]. The randn(1,N) generates a length N Gaus- 
sian random sequence with mean 0 and variance 1. Other random se- 
quences can be generated using transformations of the above functions. 

7. Periodic sequence: A sequence x(n) is periodic if x(n) = x(n + N), 
Vn. The smallest integer N that satisfies this relation is called the 
fundamental period. We will use %(n) to denote a periodic sequence. 
To generate P periods of %(n) from one period {z(n), O<n< N-1}, 
we can copy x(n) P times: 


>> xtilde = [x,x,...,x]; 


But an elegant approach is to use MATLAB’s powerful indexing capa- 
bilities. First we generate a matrix containing P rows of x(n) values. 
Then we can concatenate P rows into a long row vector using the 
construct (:). However, this construct works only on columns. Hence 
we will have to use the matrix transposition operator ’ to provide the 
same effect on rows. 


>> xtilde = x’ * ones(1,P); % P columns of x; x is a row vector 
>> xtilde = xtilde(:); % long column vector 
>> xtilde = xtilde’; % long row vector 


Note that the last two lines can be combined into one for compact 
coding. This is shown in Example 2.1. 


2.1.2 OPERATIONS ON SEQUENCES 
Here we briefly describe basic sequence operations and their MATLAB 
equivalents. 


1. Signal addition: This is a sample-by-sample addition given by 


{x1(m)} + {22(n)} = {21(n) + z2(n)} 
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It is implemented in MATLAB by the arithmetic operator “+”. How- 
ever, the lengths of xı (n) and x2(n) must be the same. If sequences are 
of unequal lengths, or if the sample positions are different for equal- 
length sequences, then we cannot directly use the operator +. We have 
to first augment x1(n) and x2(n) so that they have the same position 
vector n (and hence the same length). This requires careful attention 
to MATLAB’s indexing operations. In particular, logical operation of 
intersection “&”, relational operations like “<=” and “==”, and the 
find function are required to make x(n) and x2(n) of equal length. 
The following function, called the sigadd function, demonstrates these 
operations. 


function [y,n] = sigadd(x1,n1,x2,n2) 
% implements y(n) = x1(n)+x2(n) 


% [y,n] = sigadd(x1,ni,x2,n2) 
h y = sum sequence over n, which includes ni and n2 
% xi = first sequence over ni 


% x2 = second sequence over n2 (n2 can be different from n1) 

% 

n = min(min(n1) ,min(n2)):max(max(n1),max(n2)); % duration of y(n) 

yi = zeros(1,length(n)); y2 = y1; % initialization 
y1(find((n>=min(n1))&(n<=max(n1))==1))=x1; % x1 with duration of y 
y2(find((n>=min (n2) )&(n<=max (n2) )==1))=x2; % x2 with duration of y 
y = yl+y2; % sequence addition 


Its use is illustrated in Example 2.2. 
2. Signal multiplication: This is a sample-by-sample (or “dot” ) multi- 
plication) given by 


{x1(m)} : {x2(n)} = {x1 (n)x2(n)} 


It is implemented in MATLAB by the array operator .*. Once again, 
the similar restrictions apply for the .* operator as for the + operator. 
Therefore we have developed the sigmult function, which is similar to 
the sigadd function. 


function [y,n] = sigmult(x1,n1,x2,n2) 
% implements y(n) = x1(n)*x2(n) 


% [y,n] = sigmult (x1,n1,x2,n2) 

h y = product sequence over n, which includes ni and n2 

% xi = first sequence over ni 

% x2 = second sequence over n2 (n2 can be different from n1) 
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n = min(min(n1) ,min(m2)):max(max(n1) ,max(n2)); % duration of y(n) 


yi = zeros(1,length(n)); y2 = y1; h 

yi (find ( (n>=min(n1) )&(m<=max(n1) )==1) )=x1; % x1 with duration of y 
y2(find((n>=min(n2) ) &(n<=max (n2) )==1) )=x2; % x2 with duration of y 
y = wal ote yes % sequence multiplication 


Its use is also given in Example 2.2. 
3. Scaling: In this operation each sample is multiplied by a scalar a. 
a{x(n)} = {ax(n)} 
An arithmetic operator (*) is used to implement the scaling operation 
in MATLAB. 
4. Shifting: In this operation, each sample of x(n) is shifted by an 
amount k to obtain a shifted sequence y(n). 
y(n) = {x(n — k)} 
If we let m = n—k, then n = m+k and the above operation is given by 
y(m + k) = {x (m)} 
Hence this operation has no effect on the vector x, but the vector n is 


changed by adding k to each element. This is shown in the function 
sigshift. 


function [y,n] = sigshift(x,m,k) 
% implements y(n) = x(n-k) 


% [y,n] = sigshift (x,m,k) 
i = meda y SS ee 
Its use is given in Example 2.2. 


5. Folding: In this operation each sample of x(n) is flipped around n = 0 
to obtain a folded sequence y(n). 


y(n) = {a(—n)} 


In MATLAB this operation is implemented by fliplr (x) function for 
sample values and by -fliplr(n) function for sample positions as 
shown in the sigfold function. 


function [y,n] = sigfold(x,n) 
% implements y(n) = x(-n) 


% [y,n] = sigfold(x,n) 


y = fliplr(x); n = -fliplr(n); 
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6. Sample summation: This operation differs from signal addition 
operation. It adds all sample values of x(n) between nı and nə. 


n2 


5 x(n) = z(nı) +--+ x(n) 


n=Nn1 


It is implemented by the sum(x(n1:n2)) function. 

7. Sample products: This operation also differs from signal multi- 
plication operation. It multiplies all sample values of x(n) between 
nı and nzə. 


IED = x(n) X +++ X x(n) 


It is implemented by the prod(x(n1:n2)) function. 
8. Signal energy: The energy of a sequence x(n) is given by 


Ex = S| x(n)2*(n) = 5 |ax(n) |? 


where superscript * denotes the operation of complex conjugation.! 
The energy of a finite-duration sequence x(n) can be computed in 
MATLAB using 


>> Ex 
>> Ex 


sum(x .* conj(x)); % one approach 
sum(abs(x) .^ 2); % another approach 


9. Signal power: The average power of a periodic sequence £(n) with 
fundamental period N is given by 


1 N-1 
as g l ~ 2 


EXAMPLE 2.1 Generate and plot each of the following sequences over the indicated interval. 


a. x(n) = 26(n+ 2) — ên — 4), -5<n<5. 
b. x(n) = n[u(n)—u(n—10)]+10e7 93? fu(n— 10) — u(n—20)], 0 < n < 20. 
c. x(n) = cos(0.047n) + 0.2w(n), 0 < n < 50, where w(n) is a Gaussian 
random sequence with zero mean and unit variance. 
d. &(n) ={...,5,4,3, 2,1,5,4, 3, 2, 1,5,4,3,2,1,...}; -l0<n<9. 
i 


1The symbol * denotes many operations in digital signal processing. Its font (roman 
or computer) and its position (normal or superscript) will distinguish each operation. 
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Solution a. x(n) = 26(n + 2) — 6(n — 4), 5<n<5. 


>> n = [-5:5]; 

>> x = 2*impseq(-2,-5,5) - impseq(4,-5,5); 

>> stem(n,x); title(’Sequence in Problem 2.1a’) 
>> xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1la. 


b. a(n) = n[u(n) — u(n — 10) +10e7 93-12 [u(n — 10) — u(n — 20)],0<n< 
20. 


>> n = [0:20]; x1 = n.*(stepseq(0,0,20)-stepseq(10,0,20)); 

>> x2 = 10*exp(-0.3*(n-10)) .*(stepseq(10,0,20)-stepseq(20,0,20)); 
ve X= Site: 

>> subplot(2,2,3); stem(n,x); title(’Sequence in Problem 2.1b’) 
>> xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1b. 


Sequence in Example 2.1a Sequence in Example 2.1b 
3 
10 
‘i 8 
a 26 
= £ 
x od x 4 
2 
i i I 
ait 19e 
-2 
-5 0 5 0 5 10 15 20 
n n 
Sequence in Example 2.1c Sequence in Example 2.1d 
6 
1 
a Mi 
E 
€ o i g 
x S & Z2 
Xx 
7 ilill 
-1 0 
0 10 20 30 40 -10 -5 0 5 
n n 


FIGURE 2.1 Sequences in Example 2.1 
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c. x(n) = cos(0.047n) + 0.2w(n), O<n< 50. 


>> n = [0:50]; x = cos(0.04*pi*n)+0.2*randn(size(n)) ; 
>> subplot(2,2,2); stem(n,x); title(’Sequence in Problem 2.1c’) 
>> xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1c. 
d. Z(n) = {...,5,4, 3, 2,1,5, 4,3, 2,1,5,4,3,2,1,..$; -10<n< 9. 
T 


Note that over the given interval, the sequence Žž (n) has four periods. 


>> n = [-10:9]; x = [5,4,3,2,1]; 

>> xtilde = x’ * ones(1,4); Xtilde = (xtilde(:))’; 

>> subplot(2,2,4); stem(n,xtilde); title(’Sequence in Problem 2.1d’) 
>> xlabel(’n’); ylabel(’xtilde(n)’); 


The plot of the sequence is shown in Figure 2.1d. 


EXAMPLE 2.2 Let a(n) = {1,2,3,4,5,6,7,6,5,4,3,2,1}. Determine and plot the following 
sequences. : 


a. x1(n) = 2x(n — 5) — 3a(n+ 4) 
b. xo(n) = «(3 — n) + a(n) x(n — 2) 


Solution The sequence x(n) is nonzero over —2 < n < 10. Hence 
SS in S “Pils se = lle, @saalealle 


will generate x(n). 


a. ©1(n) = 2a(n — 5) — 3a(n + 4). 
The first part is obtained by shifting x(n) by 5 and the second part by 
shifting x(n) by —4. This shifting and the addition can be easily done using 
the sigshift and the sigadd functions. 


>> [x11,n11] = sigshift(x,n,5); [x12,n12] = sigshift(x,n,-4); 

>> [x1,n1] = sigadd(2*x11,n11,-3*x12,n12) ; 

>> subplot(2,1,1); stem(n1,x1); title(’Sequence in Example 2.2a’) 
>> xlabel(’n’); ylabel(’x1(n)’); 


The plot of 21(n) is shown in Figure 2.2a. 

b. x2(n) = «(3 — n) + a(n) x(n — 2). 
The first term can be written as «(—(n — 3)). Hence it is obtained by first 
folding x(n) and then shifting the result by 3. The second part is a multipli- 
cation of x(n) and z(n— 2), both of which have the same length but different 
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Sequence in Example 2.2a 


ja È i geen 


x1(n) 


n 


Sequence in Example 2.2b 
40 T 


Oo ọỌ 
Ọ 


ETSEAN ESF 


=T 0 12 


fo} 


FIGURE 2.2 Sequences in Example 2.2 


support (or sample positions). These operations can be easily done using the 
sigfold and the sigmult functions. 


>> [x21,n21] = sigfold(x,n); [x21,n21] = sigshift(x21,n21,3); 

>> [x22,n22] = sigshift(x,n,2); [x22,n22] = sigmult(x,n,x22,n22) ; 
>> [x2,n2] = sigadd(x21,n21,x22,n22) ; 

>> subplot(2,1,2); stem(n2,x2); title(’Sequence in Example 2.2b’) 
>> xlabel(’n’); ylabel(’x2(n)’); 


The plot of 2(n) is shown in Figure 2.2b. 


Example 2.2 shows that the four sig* functions developed in this 
section provide a convenient approach for sequence manipulations. 


EXAMPLE 2.3 Generate the complex-valued signal 
a(n) = e0103) _ag <n <10 


and plot its magnitude, phase, the real part, and the imaginary part in four 
separate subplots. 
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FIGURE 2.3 Complex-valued sequence plots in Example 2.3 


Solution MATLAB script: 


>> n = [-10:1:10]; alpha = -0.1+0.3j; 

>> x = exp(alpha*n) ; 

>> subplot(2,2,1); stem(n,real(x));title(’real part’) ;xlabel(’n’) 

>> subplot(2,2,2); stem(n,imag(x));title(’imaginary part’) ;xlabel(’n’) 

>> subplot(2,2,3); stem(n,abs(x));title(’magnitude part’) ;xlabel(’n’) 

>> subplot (2,2,4); stem(n, (180/pi)*angle(x));title(’phase part’) ;xlabel(’n’) 


The plot of the sequence is shown in Figure 2.3. 


2.1.3 DISCRETE-TIME SINUSOIDS 

In the last section we introduced the discrete-time sinusoidal sequence 
x(n) = Acos(won + 0o), for all n as one of the basic signals. This signal 
is very important in signal theory as a basis for Fourier transform and 
in system theory as a basis for steady-state analysis. It can be conve- 
niently related to the continuous-time sinusoid x(t) = Acos(Qot + Oo) 
using an operation called sampling (Chapter 3), in which continuous-time 
sinusoidal values at equally spaced points t = nT, are assigned to x(n). 
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The quantity T, is called the sampling interval, and No = wo/T, is called 
the analog frequency, measured in radians per second. 

The fact that n is a discrete variable, whereas t is a continuous 
variable, leads to some important differences between discrete-time and 
continuous-time sinusoidal signals. 


Periodicity in time From our definition of periodicity, the sinusoidal 
sequence is periodic if 
z[n+ N] = Acos(won + woN + 0) = Acos(won + 69) = z[n] (2.1) 


This is possible if and only if wo = 27k, where k is an integer. This 
leads to the following important result (see Problem P2.5): 


The sequence x(n) = Acos(won + ĝo) is periodic if and only if fo 2 
wo/2r = k/N, that is, fo is a rational number. If k and N are a 
pair of prime numbers, then N is the fundamental period of x(n) and 
k represents an integer number of periods kT, of the corresponding 
continuous-time sinusoid. 


Periodicity in frequency From the definition of the discrete-time si- 
nusoid, we can easily see that 


Acos|(wo + k2r)n + 09] = Acos(won + kn2r + Oo) 
= Acos(won + 0o) 


since (kn)2r is always an integer multiple of 27. Therefore, we have the 
following property: 


The sequence x(n) = A cos(won + 0) is periodic in wọ with fundamen- 
tal period 27 and periodic in fo with fundamental period one. 


This property has a number of very important implications: 


1. Sinusoidal sequences with radian frequencies separated by integer mul- 
tiples of 27 are identical. 

2. All distinct sinusoidal sequences have frequencies within an interval of 
2r radians. We shall use the so-called fundamental frequency ranges 


—tT<w<n or 0<w<2r (2.2) 


Therefore, if 0 < wo < 27, the frequencies wọ and wo + m2r are 
indistinguishable from the observation of the corresponding sequences. 

3. Since Acos[wo(n + no) + 6] = Acos|won + (wono + 9)], a time shift is 
equivalent to a phase change. 

4. The rate of oscillation of a discrete-time sinusoid increases as wo in- 
creases from wo = 0 to wọ = m. However, as wo increases from wo = 7 
to Wo = 27, the oscillations become slower. Therefore, low frequencies 
(slow oscillations) are at the vicinity of wọ = k27, and high frequencies 
(rapid oscillations) are at the vicinity of wọ = 7 + k2r. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


34 Chapter 2 m DISCRETE-TIME SIGNALS AND SYSTEMS 


2.1.4 SOME USEFUL RESULTS 
There are several important results in discrete-time signal theory. We will 
discuss some that are useful in digital signal processing. 


Unit sample synthesis Any arbitrary sequence x(n) can be synthe- 
sized as a weighted sum of delayed and scaled unit sample sequences, such 
as 
x(n) = X` 2(k)d(n—k) (2.3) 
k=- 


We will use this result in the next section. 


Even and odd synthesis A real-valued sequence ze(n) is called even 
(symmetric) if 
Te(—n) = ze(n) 


Similarly, a real-valued sequence x(n) is called odd (antisymmetric) if 
Lo(—n) = —x(n) 


Then any arbitrary real-valued sequence x(n) can be decomposed into its 
even and odd components 


x(n) = re(n) + x(n) (2.4) 
where the even and odd parts are given by 
Le(n) = ; [x(n) +a(—n)] and 2,(n) = ; [x(n) — a(—n)] (2.5) 


respectively. We will use this decomposition in studying properties of the 
Fourier transform. Therefore it is a good exercise to develop a simple 
MATLAB function to decompose a given sequence into its even and odd 
components. Using MATLAB operations discussed so far, we can obtain 
the following evenodd function. 


function [xe, xo, m] = evenodd(x,n) 
% Real signal decomposition into even and odd parts 


% [xe, xo, m] = evenodd(x,n) 
h 
if any(imag(x) ~= 0) 
error(’x is not a real sequence’) 
end 
m = -fliplr(n); 


mi = min([m,n]); m2 = max([m,n]); m = m1:m2; 

nm = n(1)-m(1); ni = 1:length(n) ; 

x1 = zeros(1,length(m)) ; xi(mitnm) = x; x = x1; 
xe = 0.5*(x + fliplr(x)); xo = 0.5*(x - fliplr(x)); 
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FIGURE 2.4 Even-odd decomposition in Example 2.4 


The sequence and its support are supplied in x and n arrays, respectively. 
It first checks if the given sequence is real and determines the support 
of the even and odd components in m array. It then implements (2.5) 
with special attention to the MATLAB indexing operation. The resulting 
components are stored in xe and xo arrays. 


EXAMPLE 2.4 Let x(n) = u(n) — u(n — 10). Decompose x(n) into even and odd components. 


Solution The sequence x(n), which is nonzero over 0 < n < 9, is called a rectangular 
pulse. We will use MATLAB to determine and plot its even and odd parts. 


>> n = [0:10]; x = stepseq(0,0,10)-stepseq(10,0,10) ; 

>> [xe,xo,m] = evenodd(x,n) ; 

>> subplot(2,2,1); stem(n,x); title(’Rectangular pulse’) 
>> xlabel(’n’); ylabel(’x(n)’); axis([-10,10,0,1.2]) 

>> subplot(2,2,2); stem(m,xe); title(’Even Part’) 

>> xlabel(’n’); ylabel(’xe(n)’); axis([-10,10,0,1.2]) 

>> subplot(2,2,4); stem(m,xo); title(’Odd Part’) 

>> xlabel(’n’); ylabel(’xe(n)’); axis([-10,10,-0.6,0.6]) 


The plots shown in Figure 2.4 clearly demonstrate the decomposition. 
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A similar decomposition for complex-valued sequences is explored in 
Problem P2.5. 


The geometric series A one-sided exponential sequence of the form 
{a”, n> 0}, where a is an arbitrary constant, is called a geometric 
series. In digital signal processing, the convergence and expression for the 
sum of this series are used in many applications. The series converges for 
|a| < 1, while the sum of its components converges to 


= 1 
Sa — —, for ja|<1 (2.6) 
rae l-a 


We will also need an expression for the sum of any finite number of terms 
of the series given by 


N-1 SNe 
DS a” = a ,Va (2.7) 
ar l-a 


These two results will be used throughout this book. 


Correlations of sequences Correlation is an operation used in many 
applications in digital signal processing. It is a measure of the degree to 
which two sequences are similar. Given two real-valued sequences x(n) and 
y(n) of finite energy, the crosscorrelation of x(n) and y(n) is a sequence 
Tzy(£) defined as 


resl) = $ a(n)y(n— 4) (2.8) 
The index £ is called the shift or lag parameter. The special case of (2.8) 
when y(n) = x(n) is called autocorrelation and is defined by 

Tox(l) = 5 x(n)x(n — £) (2.9) 
It provides a measure of self-similarity between different alignments of the 
sequence. MATLAB functions to compute auto- and crosscorrelations are 
discussed later in the chapter. 


2.2 DISCRETE SYSTEMS 
—— g 


Mathematically, a discrete-time system (or discrete system for short) is 
described as an operator T[-] that takes a sequence x(n) (called excitation) 
and transforms it into another sequence y(n) (called response). That is, 
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In DSP we will say that the system processes an input signal into an output 
signal. Discrete systems are broadly classified into linear and nonlinear 
systems. We will deal mostly with linear systems. 


2.2.1 LINEAR SYSTEMS 
A discrete system T|] is a linear operator L[-] if and only if L[-] satisfies 
the principle of superposition, namely, 


Llayx1(n) + agxvo(n)] = a, L[21(n)] + a2gL[xo(n)], Var, a2, xı (n), vo(n) 
(2.10) 


Using (2.3) and (2.10), the output y(n) of a linear system to an arbitrary 
input x(n) is given by 


y(n) = L{x(n)] = | S> ak) 6(n - J = Y> a(k)L[o(n—b)] 


n=— oo n=— Co 


The response L[6(n — k)] can be interpreted as the response of a linear 
system at time n due to a unit sample (a well-known sequence) at time k. 
It is called an impulse response and is denoted by h(n, k). The output 
then is given by the superposition summation 


Co 


y(n) = X` z(k)h(n,k) (2.11) 


n=—Cco 


The computation of (2.11) requires the time-varying impulse response 
h(n, k), which in practice is not very convenient. Therefore time-invariant 
systems are widely used in DSP. 


EXAMPLE 2.5 Determine whether the following systems are linear: 
1. y(n) = Tie(n)] = 30?(n) 
2. y(n) = 2a(n — 2) +5 
3. y(n) = a(n+1)—2(n—-1) 


Solution Let yi(n) = T{xi(n)] and yo(n) = T[x2(n)]. We will determine the 
response of each system to the linear combination a1xı(n) + a2x2(n) and 
check whether it is equal to the linear combination a121(n) + azx2(n) 
where a; and ag are arbitrary constants. 


1. y(n) = T[x(n)] = 3x?(n): Consider 


T [a,21(n) + azzə(n)] = 3 [axı (n) + a2%2(n)]” 


= 3a?x? (n) + 3a323(n) + 6ayaz21(n)r2(n) 
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which is not equal to 
aryr(n) + azy2(n) = 3a127 (n) + 3a323(n) 
Hence the given system is nonlinear. 
2. y(n) = 2a(n — 2) + 5: Consider 
T [a,21(n) + agxo(n)] = 2 [axı (n — 2) + agre(n — 2)] +5 
= ayı (n) + agye(n) — 5 


Clearly, the given system is nonlinear even though the input-output 
relation is a straight-line function. 
3. y(n) = x(n + 1) — a(1 — n): Consider 
T|aizı(n) + agxe(n)] = arai(n + 1) + azzə(n + 1) + azı (1 — n) 
+azz2(1 — n) 
= aļzı(n+1)-—zı(1-n)] 
+az|za(n + 1) — z2(1 — n)] 
= ayı (n) + azy2(n) 


Hence the given system is linear. 


Linear time-invariant (LTI) system A linear system in which an 
input-output pair, x(n) and y(n), is invariant to a shift k in time is called 
a linear time-invariant system i.e., 


y(n) = L{x(n)] = Llx(n — k)] = y(n — k) (2.12) 


For an LTI system the L{-] and the shifting operators are reversible as 
shown here. 


x(n) Lj] y(n) Shift by k| — y(n — k) 


x(n) — | Shift by k x(n — k) L] y(n — k) 


EXAMPLE 2.6 Determine whether the following linear systems are time-invariant. 


1. y(n) = L[x(n)] = 10sin(0.17n)a(n) 
2. y(n) = L[x(n)] = a(n +1)-—a2(1—n) 


3. y(n) = L[x(n)] = ¢2(n) + a(n — 1) + 4a(n— 2) 


Solution First we will compute the response yp(n) £ L{x(n — k)] to the shifted 
input sequence. This is obtained by subtracting k from the arguments of 
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every input sequence term on the right-hand side of the linear transforma- 
tion. To determine time-invariance, we will then compare it to the shifted 
output sequence y(n — k), obtained after replacing every n by (n — k) on 
the right-hand side of the linear transformation. 


1. y(n) = L[x(n)| = 10sin(0.17n)a(n): The response due to shifted 
input is 


y(n) = Li[a(n — k)] = 10sin(0.1rn)e(n — k) 
while the shifted output is 
y(n — k) = 10sin[0.17(n — k)je(n — k) F yx (n). 
Hence the given system is not time-invariant. 
2. y(n) = L[x(n)| = x(n + 1) — z(1 — n): The response due to shifted 
input is 


yn (n) = Li[a(n — k)] = a(n — k) — (1 — n — k) 


while the shifted output is 
y(n—k) = a(n—k)—a(1—[n—k]) = a(n—k)-—a(1—nt+k) F ykln). 


Hence the given system is not time-invariant. 
3. y(n) = Lia(n)] = x(n) + x(n — 1) + x(n — 2): The response due 
to shifted input is 


yn (n) = L[x(n — k)] = ¢a(n—k) + x(n — 1 — k) + x(n — 2 — k) 


y(n — k) = $a(n—k) + e(n — k — 1) + e(n — k — 2) = y(n) 


1 
2 


Hence the given system is time-invariant. 


We will denote an LTI system by the operator LTI [|]. Let x(n) and 
y(n) be the input-output pair of an LTI system. Then the time-varying 
function h(n, k) becomes a time-invariant function h(n — k), and the out- 
put from (2.11) is given by 


OO 


y(n) = LTI [e(n] = X` a(k)h(n—k) (2.13) 


k=—0o 


The impulse response of an LTI system is given by h(n). The mathemati- 
cal operation in (2.13) is called a linear convolution sum and is denoted by 


y(n) Ê a(n) * h(n) (2.14) 
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Hence an LTI system is completely characterized in the time domain by 
the impulse response h(n). 


We will explore several properties of the convolution in Problem P2.14. 


Stability This is a very important concept in linear system theory. The 
primary reason for considering stability is to avoid building harmful sys- 
tems or to avoid burnout or saturation in the system operation. A system 
is said to be bounded-input bounded-output (BIBO) stable if every bounded 
input produces a bounded output. 


|2(n)| < œ = |y(n)| < œ, Vary 


An LTI system is BIBO stable if and only if its impulse response is abso- 
lutely summable. 


BIBO Stability = S  |h(n)| < œ (2.15) 


Causality This important concept is necessary to make sure that sys- 
tems can be built. A system is said to be causal if the output at index no 
depends only on the input up to and including the index no; that is, the 
output does not depend on the future values of the input. An LTI system 
is causal if and only if the impulse response 


h(n) =0, n<0 (2.16) 


Such a sequence is termed a causal sequence. In signal processing, unless 
otherwise stated, we will always assume that the system is causal. 


2.3 CONVOLUTION 
—— g 


We introduced the convolution operation (2.14) to describe the response 
of an LTI system. In DSP it is an important operation and has many other 
uses that we will see throughout this book. Convolution can be evaluated 
in many different ways. If the sequences are mathematical functions (of 
finite or infinite duration), then we can analytically evaluate (2.14) for all 
n to obtain a functional form of y(n). 


EXAMPLE 2.7 Let the rectangular pulse x(n) = u(n) — u(n — 10) of Example 2.4 be an input 
to an LTI system with impulse response 


h(n) = (0.9)” u(n) 
Determine the output y(n). 
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Convolution 


Solution 


CASE i 


CASE ii 
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FIGURE 2.5 The input sequence and the impulse response in Example 2.7 


The input x(n) and the impulse response h(n) are shown in Figure 2.5. From 
(2.14) 


9 9 


y(n) = X1) (0.9) u(n — k) = (0.9)" X © (0.9) -* u(n — k) 


k=0 k=0 


(2.17) 


The sum in (2.17) is almost a geometric series sum except that the term u(n—k) 
takes different values depending on n and k. There are three possible conditions 
under which u(n — k) can be evaluated. 


n <0: Then u(n — k)=0, O0<k <9. Hence from (2.17) 


y(n) =0 (2.18) 
In this case the nonzero values of x(n) and h(n) do not overlap. 
0<n< 9: Then u(n — k) =1,0<k < n. Hence from (2.17) 
y(n) = (0.9)” X` (0.9)=* = (0.9)" S“[(0.9) 7] 
k=0 k=0 
— (0,9) - th) 
= (0.9)” esl) = 10[1-(0.9)"""], 0<n<9 (2.19) 


1— (0.9)-! 
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Output Sequence 
T 


N 
T 


ad i L (UTi 


15 20 25 30 3 45 
n 


| 
ol 
oa 


FIGURE 2.6 The output sequence in Example 2.7 


CASE iii In this case the impulse response h(n) partially overlaps the input x(n). 
n > 9: Then u(n — k) = 1,0 < k < 9 and from (2.17) 
9 
y(n) = (0.9)" $ 10.9)" 
k=0 


,1—(0.9)-20 | E ; ii 
T= Oger O — 09"), n29 (2.20) 


In this last case h(n) completely overlaps x(n). 


= (0.9) 


The complete response is given by (2.18), (2.19), and (2.20). It is shown in 
Figure 2.6 which depicts the distortion of the input pulse. 


This example can also be done using a method called graphical convo- 
lution, in which (2.14) is given a graphical interpretation. In this method, 
h(n — k) is interpreted as a folded-and-shifted version of h(k). The output 
y(n) is obtained as a sample sum under the overlap of x(k) and h(n — k). 
We use an example to illustrate this. 


EXAMPLE 2.8 Given the following two sequences 


a(n) = [3,11,7,0,—1,4,2], -3<n<3; A(n) =(2,3,0,—5,2,1], -1<n<4 
T T 


determine the convolution y(n) = x(n) * h(n). 


Solution In Figure 2.7 we show four plots. The top-left plot shows x(k) and h(k), the 
original sequences. The top-right plot shows x(k) and h(—k), the folded version 
of h(k). The bottom-left plot shows x(k) and h(—1—k), the folded-and-shifted- 
by- —1 version of h(k). Then 


S > a(k)h(-1- k) = 3 x (-5) +11 x04+7x340x2=6=y(-1) 


The bottom-right plot shows x(k) and h(2 — k), the folded-and-shifted-by-2 
version of h(k), which gives 


S| a(k)h(2—k) = 11x 1+7x 2+0x (—5) + (-1) x0+4x 3422 = 41 = y(2) 
k 
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FIGURE 2.7 Graphical convolution in Example 2.8 


Thus we have obtained two values of y(n). Similar graphical calculations can 
be done for other remaining values of y(n). Note that the beginning point (first 
nonzero sample) of y(n) is given by n = —3 + (—1) = —4, while the end point 
(the last nonzero sample) is given by n = 3 + 4 = 7. The complete output is 
given by 


y(n) = {6, 31, 47, 6, —51, —5, 41, 18, —22, —3, 8, 2} 
ci 


Students are strongly encouraged to verify the above result. Note that the re- 
sulting sequence y(n) has a longer length than both the x(n) and h(n) sequences. 


2.3.1 MATLAB IMPLEMENTATION 

If arbitrary sequences are of infinite duration, then MATLAB cannot 
be used directly to compute the convolution. MATLAB does provide a 
built-in function called conv that computes the convolution between two 
finite-duration sequences. The conv function assumes that the two se- 
quences begin at n = 0 and is invoked by 


>> y = conv(x,h); 
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For example, to do the convolution in Example 2.7, we could use 


Se eS IS, Wil, 75 Oy =, 4, 25 WS Is Ss O =By 2, ills 
>> y = conv(x, h) 


6 31 47 6 -51 -5 41 18 -22 =S 8 2 


to obtain the correct y(n) values. However, the conv function neither 
provides nor accepts any timing information if the sequences have arbi- 
trary support. What is needed is a beginning point and an end point of 
y(n). Given finite duration x(n) and h(n), it is easy to determine these 
points. Let 

{x(n); Nep SNS Nze} and {h(n); Nh SNS Nhe} 
be two finite-duration sequences. Then referring to Example 2.8 we ob- 
serve that the beginning and end points of y(n) are 

Nyb = Nab + Nhp and Nye = Nee + Nhe 

respectively. A simple modification of the conv function, called conv_m, 
which performs the convolution of arbitrary support sequences can now 
be designed. 


function [y,ny] = conv_m(x,nx,h,nh) 
% Modified convolution routine for signal processing 
Ye cE 


% [y,ny] = conv_m(x,nx,h,nh) 
% [y,ny] = convolution result 
= first signal 
second signal 


x os 
Dn a 
Dy 
B B 
D x 
ow 
"od 


nyb = nx(1)+nh(1); nye = nx(length(x)) + nh(length(h)) ; 
ny = [nyb:nye]; y = conv(x,h); 


EXAMPLE 2.9 Perform the convolution in Example 2.8 using the conv_m function. 


Solution MATLAB script: 


>> xX 
>>h 


[3, 11, 7, 0, -1, 4, 2]; nx = [-3:3]; 
Bs 35 0, 5, 2, alls my = [alse] s 


>> [y,ny] = conv_m(x,nx,h,nh) 
y= 
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Hence 


y(n) = {6, 31, 47, 6, —51, —5, 41, 18, —22, —3, 8, 2} 
T 


as in Example 2.8. 


An alternate method in MATLAB can be used to perform the convo- 
lution. This method uses a matrix-vector multiplication approach, which 
we will explore in Problem P2.17. 


2.3.2 SEQUENCE CORRELATIONS REVISITED 

If we compare the convolution operation (2.14) with that of the crosscor- 
relation of two sequences defined in (2.8), we observe a close resemblance. 
The crosscorrelation ry,(@) can be put in the form 


Tyx(t) = y(£) * x(—£) 
with the autocorrelation rz.(¢) in the form 
Tor(l) = x(€) x z(—£) 


Therefore these correlations can be computed using the conv_m function 
if sequences are of finite duration. 


EXAMPLE 2.10 In this example we will demonstrate one application of the crosscorrelation 
sequence. Let 


x(n) = [3, 11, 7, 0, —1,4, 2] 
T 


be a prototype sequence, and let y(n) be its noise-corrupted-and-shifted version 
y(n) = x(n — 2) + w(n) 


where w(n) is Gaussian sequence with mean 0 and variance 1. Compute the 
crosscorrelation between y(n) and x(n). 


Solution From the construction of y(n) it follows that y(n) is “similar” to x(n — 2) and 
hence their crosscorrelation would show the strongest similarity at @ = 2. To 
test this out using MATLAB, let us compute the crosscorrelation using two 
different noise sequences. 


% noise sequence 1 
>> x = [3, 11, 7, 0, -1, 4, 2]; nx=[-3:3]; % given signal x(n) 


>> [y,ny] = sigshift(x,nx, 2); % obtain x(n-2) 
>> w = randn(1,length(y)); nw = ny; % generate w(n) 
>> [y,ny] = sigadd(y,ny,w,nw) ; % obtain y(n) = x(m-2) + w(n) 
>> [x,nx] = sigfold(x,nx); % obtain x(-n) 
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Crosscorrelation: Noise Sequence 1 


250 T T T T 
200 F Maximum 4 
150 F 4 
100 } | 
a = 
oe i ® 0) 5 Q i 
—50 1 i 1 1 L 
-4 -2 0 2 4 6 8 
Lag Variable | 
Crosscorrelation: Noise Sequence 2 
T T T T 
200 + Maximum 1 
150 F 4 
100 + J 
50 H j | | 
—50 1 1 1 1 L 
—4 -2 0 2 4 6 8 


Lag Variable | 


FIGURE 2.8 Crosscorrelation sequence with two different noise realizations 


>> [rxy,nrxy] = conv_m(y,ny,x,nx) ; % crosscorrelation 
>> subplot(1,1,1), subplot (2,1,1);stem(nrxy,rxy) 

>> axis([-5,10,-50,250]);xlabel(’lag variable 1’) 

>> ylabel(’rxy’);title(’Crosscorrelation: noise sequence 1’) 


% noise sequence 2 
>> x = [3, 11, 7, 0, -1, 4, 2]; nx=[-3:3]; % given signal x(n) 


>> [y,ny] = sigshift(x,nx,2); % obtain x(n-2) 

>> w = randn(1,length(y)); nw = ny; % generate w(n) 

>> [y,ny] = sigadd(y,ny,w,nw) ; % obtain y(n) = x(m-2) + w(n) 
>> [x,nx] = sigfold(x,nx); % obtain x(-n) 

>> [rxy,nrxy] = conv_m(y,ny,x,nx) ; % crosscorrelation 


>> subplot (2,1,2);stem(mrxy,rxy) 
>> axis([-5,10,-50,250]);xlabel(’lag variable 1’) 
>> ylabel(’rxy’);title(’Crosscorrelation: noise sequence 2’) 


From Figure 2.8 we observe that the crosscorrelation indeed peaks at £ = 2, 
which implies that y(n) is similar to x(n) shifted by 2. This approach can be 
used in applications like radar signal processing in identifying and localizing 
targets. 
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Note that the signal-processing toolbox in MATLAB also provides a 
function called xcorr for sequence correlation computations. In its sim- 
plest form 


>> xcorr(x,y) 


computes the crosscorrelation between vectors x and y, while 
>> xcorr(x) 


computes the autocorrelation of vector x. It generates results that are 
identical to the one obtained from the proper use of the conv_m function. 
However, the xcorr function cannot provide the timing (or lag) informa- 
tion (as done by the conv_m function), which then must be obtained by 
some other means. 


2.4 DIFFERENCE EQUATIONS 
—— g 


An LTI discrete system can also be described by a linear constant coeffi- 
cient difference equation of the form 


N M 
5 aky(n — k) = 5 bme(n-—- m), Vn (2.21) 
k=0 m=0 


If ay £0, then the difference equation is of order N. This equation de- 
scribes a recursive approach for computing the current output, given the 
input values and previously computed output values. In practice this equa- 
tion is computed forward in time, from n = —oo to n = co. Therefore 
another form of this equation is 


M N 
y(n) = 5 bmx(n — m) — 5 aky(n — k) (2.22) 
m=0 k=1 


A solution to this equation can be obtained in the form 
y(n) = ya (n) + yp(n) 


The homogeneous part of the solution, yp (n), is given by 


N 
yu(n) =X zk 
k=1 
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where zk, k = 1,...,N are N roots (also called natural frequencies) of the 
characteristic equation R 
bD a,z* =0 
0 


This characteristic equation is important in determining the stability of 
systems. If the roots z, satisfy the condition 


lee] <1, k= 1,...,N (2.23) 


then a causal system described by (2.22) is stable. The particular part 
of the solution, yp(n), is determined from the right-hand side of (2.21). 
In Chapter 4 we will discuss the analytical approach of solving difference 
equations using the z-transform. 


2.4.1 MATLAB IMPLEMENTATION 

A function called filter is available to solve difference equations nu- 
merically, given the input and the difference equation coefficients. In its 
simplest form this function is invoked by 


y = filter(b,a,x) 


where 
iy =N il, Aeon Wiles eS [RO ell, ooc5 aN]; 


are the coefficient arrays from the equation given in (2.21), and x is the 
input sequence array. The output y has the same length as input x. One 
must ensure that the coefficient a0 not be zero. 

To compute and plot impulse response, MATLAB provides the func- 
tion impz. When invoked by 


h = impz(b,a,n); 


it computes samples of the impulse response of the filter at the sample 
indices given in n with numerator coefficients in b and denominator co- 
efficients in a. When no output arguments are given, the impz function 
plots the response in the current figure window using the stem function. 
We will illustrate the use of these functions in the following example. 


EXAMPLE 2.11 Given the following difference equation 


y(n) — y(n — 1) +0.9y(n — 2) = a(n); Yn 


a. Calculate and plot the impulse response h(n) at n = —20,..., 100. 
b. Calculate and plot the unit step response s(n) at n = —20,...,100. 
c. Is the system specified by h(n) stable? 
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Solution From the given difference equation the coefficient arrays are 
= (Bly elt, =, O.Oils 
a. MATLAB script: 


>> b = [1]; a = [1, -1, 0.9]; n = [-20:120]; 

>> h = impz(b,a,n); 

>> subplot(2,1,1); stem(n,h); 

>> title(’Impulse Response’); xlabel(’n’); ylabel(’h(n)’) 


The plot of the impulse response is shown in Figure 2.9. 
b. MATLAB script: 


>> x = stepseq(0,-20,120); s = filter(b,a,x); 
>> subplot(2,1,2); stem(n,s) 
>> title(’Step Response’); xlabel(’n’); ylabel(’s(m)’) 


The plot of the unit step response is shown in Figure 2.9. 


c. To determine the stability of the system, we have to determine h(n) for all n. 
Although we have not described a method to solve the difference equation, 


Impulse Response 


-20 0 20 40 60 80 100 120 


0859 0 20 40 60 80 100 120 


FIGURE 2.9 Impulse response and step response plots in Example 2.11 
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we can use the plot of the impulse response to observe that h(n) is practically 
zero for n > 120. Hence the sum J` |h(n)| can be determined from MATLAB 
using 


>> sum(abs (h) ) 
ans = 14.8785 


which implies that the system is stable. An alternate approach is to use the 
stability condition (2.23) using MATLAB’s roots function. 


>>z = roots(a); magz = abs(z) 
magz = 0.9487 
0.9487 


Since the magnitudes of both roots are less than one, the system is stable. 


In the previous section we noted that if one or both sequences in 
the convolution are of infinite length, then the conv function cannot be 
used. If one of the sequences is of infinite length, then it is possible to use 
MATLAB for numerical evaluation of the convolution. This is done using 
the filter function as we will see in the following example. 


EXAMPLE 2.12 Let us consider the convolution given in Example 2.7. The input sequence is of 
finite duration 


x(n) = u(n) — u(n — 10) 
while the impulse response is of infinite duration 
h(n) = (0.9)” u(n) 
Determine y(n) = x(n) * h(n). 


Solution If the LTI system, given by the impulse response h(n), can be described by a 
difference equation, then y(n) can be obtained from the filter function. From 
the h(n) expression 


(0.9) h(n — 1) = (0.9) (0.9)”~! u(n — 1) = (0.9)” u(n — 1) 
h(n) — (0.9) h(n — 1) = (0.9)” u(n) — (0.9)” u(n — 1) 
.9)" fu(n) — u(n — 1)] = (0.9)" 8(n) 
= 6(n) 
The last step follows from the fact that (n) is nonzero only at n = 0. By 


definition h(n) is the output of an LTI system when the input is 6(n). Hence 
substituting x(n) for 6(n) and y(n) for h(n), the difference equation is 


y(n) — 0.9y(n — 1) = x(n) 
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Output Sequence 
8 T T T T 


| i Tiits 


L 
-5 0 5 10 15 20 25 30 35 40 45 
n 


FIGURE 2.10 Output sequence in Example 2.12 


Now MATLAB’s filter function can be used to compute the convolution in- 


directly. 
>> b = [1]; a = [1,-0.9]; 
>> n = -5:50; x = stepseq(0,-5,50) - stepseq(10,-5,50); 


>> y = filter(b,a,x); 
>> subplot (2,1,2); stem(n,y); title(’Output sequence’) 
>> xlabel(’n’); ylabel(’y(n)’); axis([-5,50,-0.5,8]) 


The plot of the output is shown in Figure 2.10, which is exactly the same as 
that in Figure 2.6. 


In Example 2.12 the impulse response was a one-sided exponential se- 
quence for which we could determine a difference equation representation. 
This means that not all infinite-length impulse responses can be converted 
into difference equations. The above analysis, however, can be extended to 
a linear combination of one-sided exponential sequences, which results in 
higher-order difference equations. We will discuss this topic of conversion 
from one representation to another one in Chapter 4. 


2.4.2 ZERO-INPUT AND ZERO-STATE RESPONSES 

In digital signal processing the difference equation is generally solved for- 
ward in time from n = 0. Therefore initial conditions on x(n) and y(n) 
are necessary to determine the output for n > 0. The difference equation 
is then given by 


M N 
y(n) = 5 bm«(n — m) — y aky(n- k); n> 0 (2.24) 
k=1 


m=0 
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subject to the initial conditions: 
{y(n); -N <n < —1} and {z(n); -M < n < —1} 
A solution to (2.24) can be obtained in the form 


y(n) = yzr(n) + yzs(n) 


where yz7(n) is called the zero-input solution, which is a solution due 
to the initial conditions alone (assuming they exist), while the zero-state 
solution, yzs(n), is a solution due to input x(n) alone (or assuming that 
the initial conditions are zero). In MATLAB another form of the function 
filter can be used to solve for the difference equation, given its initial 
conditions. We will illustrate the use of this form in Chapter 4. 


2.4.3 DIGITAL FILTERS 

Filter is a generic name that means a linear time-invariant system designed 
for a specific job of frequency selection or frequency discrimination. Hence 
discrete-time LTI systems are also called digital filters. There are two 
types of digital filters. 


FIR filter If the unit impulse response of an LTI system is of finite 
duration, then the system is called a finite-duration impulse response (or 
FIR) filter. Hence for an FIR filter h(n) = 0 for n < nı and for n > no. 
The following part of the difference equation (2.21) describes a causal FIR 
filter: 


M 
y(n) = X` bmz(n— m) (2.25) 
m=0 

Furthermore, h(0) = bo, h(1) = bi, ..., h(M) = bm, while all other h(n)’s 
are 0. FIR filters are also called nonrecursive or moving average (MA) 
filters. In MATLAB FIR filters are represented either as impulse response 
values {h(n)} or as difference equation coefficients {bm} and {ao = 1}. 
Therefore to implement FIR filters, we can use either the conv(x,h) 
function (and its modification that we discussed) or the filter (b,1,x) 
function. There is a difference in the outputs of these two implementations 
that should be noted. The output sequence from the conv(x,h) function 
has a longer length than both the x(n) and h(n) sequences. On the other 
hand, the output sequence from the filter(b,1,x) function has exactly 
the same length as the input x(n) sequence. In practice (and especially 
for processing signals) the use of the filter function is encouraged. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Problems 53 


IIR filter If the impulse response of an LTI system is of infinite dura- 
tion, then the system is called an infinite-duration impulse response (or 
IIR) filter. The following part of the difference equation (2.21): 


N 
X axy(n — k) = x(n) (2.26) 
k=0 


describes a recursive filter in which the output y(n) is recursively com- 
puted from its previously computed values and is called an autoregressive 
(AR) filter. The impulse response of such filter is of infinite duration and 
hence it represents an IR filter. The general equation (2.21) also describes 
an IIR filter. It has two parts: an AR part and an MA part. Such an IIR 
filter is called an autoregressive moving average, or an ARMA, filter. In 
MATLAB, IIR filters are described by the difference equation coefficients 
{bm} and {ap} and are implemented by the filter (b,a,x) function. 


2.5 PROBLEMS 
—— g 


P2.1 Generate the following sequences using the basic MATLAB signal functions and the basic 
MATLAB signal operations discussed in this chapter. Plot signal samples using the stem 
function. 


) 
2. x(n) =J __,e7řló(n — 2k), —10 < n < 10. 
3. xz3(n) = 10u(n) — 5u(n — 5) — 10u(n — 10) + 5u(n — 15). 
4. x4(n) =e?" [u(n + 20) — u(n — 10)]. 
5. x(n) = 5[cos(0.49rn) + cos(0.51rn)], —200 < n < 200. Comment on the waveform 
shape 
6. x6(n) = 2sin(0.017n) cos(0.57n), —200 < n < 200. Comment on the waveform shape. 
7. a7(n) = e7 °°” sin(0.1rn + 7/3), 0 <n < 100. Comment on the waveform shape. 
8. ag(n) =e?!" sin(0.1rn), 0 < n < 100. Comment on the waveform shape. 


P2.2 Generate the following random sequences and obtain their histogram using the hist 
function with 100 bins. Use the bar function to plot each histogram. 


1. x1(n) is a random sequence whose samples are independent and uniformly distributed 
over [0,2] interval. Generate 100,000 samples. 

2. x(n) is a Gaussian random sequence whose samples are independent with mean 10 and 
variance 10. Generate 10,000 samples. 

3. 23(n) = zı (n) + xı (n — 1) where x1(n) is the random sequence given in part 1 above. 
Comment on the shape of this histogram and explain the shape. 

4. xa(n) = es yk(n) where each random sequence yx(n) is independent of others with 
samples uniformly distributed over [—0.5, 0.5]. Comment on the shape of this histogram. 
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P2.3 Generate the following periodic sequences and plot their samples (using the stem function) 
over the indicated number of periods. 


1. &1(n) = {...,-2,-1,0,1,2,..-}perioaic. Plot 5 periods. 
i 


2. a(n) = e™t” [u(n) — u(n — 20]periodic. Plot 3 periods. 
3. ža(n) = sin(0.17n)[u(n) — u(n — 10)]. Plot 4 periods. 
4. a(n) = {+ 1,2,3,- Iperiodic + {+-+ 1,2,3,4- -Jperiodic» 0 S n < 24. What is the 


period of ž4(n)? 


P2.4 Let x(n) = {2, 4, -3,1,—5,4,7}. Generate and plot the samples (use the stem function) of 
T 


the following sequences. 


1. xı(n) = 2a(n — 3) 


2. x(n) x 
3. x3(n) = (n+ 3)a(n — 2) + a(1 — n)a(n + 1) 
4. xa(n) = 2e°°" a(n) + cos (0.12) g (n +2), —10 < n < 10 


P2.5 The complex exponential sequence ef“0” or the sinusoidal sequence cos (won) are periodic if 


the normalized frequency fo = = is a rational number; that is, fo = N’ where K and N 

are integers. A 

1. Prove the above result. 

2. Generate exp(0.17n), —100 < n < 100. Plot its real and imaginary parts using the stem 
function. Is this sequence periodic? If it is, what is its fundamental period? From the 
examination of the plot what interpretation can you give to the integers K and N above? 

3. Generate and plot cos(0.1n), —20 < n < 20. Is this sequence periodic? What do you 
conclude from the plot? If necessary examine the values of the sequence in MATLAB to 
arrive at your answer. 


P2.6 Using the evenodd function, decompose the following sequences into their even and odd 
components. Plot these components using the stem function. 


1. x1(n) = {0,1,2, 3, 4,5, 6, 7,8, 9}. 
T 
2. x(n) = e" [u(n + 5) — u(n — 10)]. 
3. xz3(n) = cos(0.2mrn + 7/4), —20 < n < 20. 
4. xa(n) = e7” sin(0.1rn + 7/3), 0 <n < 100. 


P2.7 A complex-valued sequence x(n) is called conjugate-symmetric if ze(n) = xž(—n) and a 
complex-valued sequence xo(n) is called conjugate-antisymmetric if xo(n) = —x3(—n). 
Then, any arbitrary complex-valued sequence x(n) can be decomposed into 
x(n) = x(n) + x(n) where xe(n) and zo(n) are given by 


many Ree Cn) Bandy ei CC en] (2.27) 


respectively. 
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1. Modify the evenodd function discussed in the text so that it accepts an arbitrary 
sequence and decomposes it into its conjugate-symmetric and conjugate-antisymmetric 
components by implementing (2.27). 

2. Decompose the following sequence: 


x(n) = 10exp([-0.1 + 0.27]n), O<n< 10 


into its conjugate-symmetric and conjugate-antisymmetric components. Plot their real 
and imaginary parts to verify the decomposition. (Use the subplot function.) 


P2.8 The operation of signal dilation (or decimation or down-sampling) is defined by 
y(n) = z(nM) 


in which the sequence x(n) is down-sampled by an integer factor M. For example, if 


a(n)={..., 2,4,3, 6,5,—1,8,...} 


then the down-sampled sequences by a factor 2 are given by 
y(n) = {...,—2,3,5,8,...} 
T 


1. Develop a MATLAB function dnsample that has the form 


function [y,m] = dnsample(x,n,M) 
% Downsample sequence x(n) by a factor M to obtain y(m) 


to implement the above operation. Use the indexing mechanism of MATLAB with 
careful attention to the origin of the time axis n = 0. 


2. Generate x(n) = sin(0.1257n), — 50 <n < 50. Decimate x(n) by a factor of 4 to 
generate y(n). Plot both x(n) and y(n) using subplot and comment on the results. 
3. Repeat the above using x(n) = sin(0.57n), — 50 < n < 50. Qualitatively discuss the 


effect of down-sampling on signals. 


P2.9 Using the conv_m function, determine the autocorrelation sequence rzz(€) and the 
crosscorrelation sequence rzy(£) for the following sequences. 


x(n) = (0.9)", O<n< 20; y(n) = (0.8)"",  —20<n<0 
Describe your observations of these results. 


P2.10 In a certain concert hall, echoes of the original audio signal x(n) are generated due to the 
reflections at the walls and ceiling. The audio signal experienced by the listener y(n) is a 
combination of x(n) and its echoes. Let 


y(n) = a(n) + ax(n — k) 


where k is the amount of delay in samples and a is its relative strength. We want to 
estimate the delay using the correlation analysis. 
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1. Determine analytically the crosscorrelation ryz(€) in terms of the autocorrelation rz2(). 
2. Let x(n) = cos(0.27n) + 0.5cos(0.67n), a = 0.1, and k = 50. Generate 200 samples of 
y(n) and determine its crosscorrelation. Can you obtain a and k by observing ry. (@)? 


P2.11 Consider the following discrete-time systems: 


Ti [x(n)] = x(n)u(n) Ta[x(n)] = x(n) +na(n + 1) 


z(n— 2) a(n 3)z(2n)  Tale(n)]= 5t _ 22(k) 


k=—0o 


Ts[x(n)] = x(2n) Te[x(n)] = round[x(n)] 
where round[-] denotes rounding to the nearest integer. 


1. Use (2.10) to determine analytically whether these systems are linear. 

2. Let x1(n) be a uniformly distributed random sequence between [0,1] over 0 < n < 100, 
and let x2(n) be a Gaussian random sequence with mean 0 and variance 10 over 
0<n< 100. Using these sequences, verify the linearity of these systems. Choose any 
values for constants a; and a2 in (2.10). You should use several realizations of the above 
sequences to arrive at your answers. 


P2.12 Consider the discrete-time systems given in Problem P2.11. 


1. Use (2.12) to determine analytically whether these systems are time-invariant. 

2. Let x(n) be a Gaussian random sequence with mean 0 and variance 10 over 0 < n < 100. 
Using this sequence, verify the time invariance of the above systems. Choose any values 
for sample shift k in (2.12). You should use several realizations of the above sequence to 
arrive at your answers. 


P2.13 For the systems given in Problem P2.11, determine analytically their stability and causality. 
P2.14 The linear convolution defined in (2.14) has several properties: 


xi(n) * v2(n) = xı (n) * x2(n) : Commutation 
[xı (n) x x2(n)] * xa (n) = xı (n) * [x2(n) x x3 (n)] : Association (2.28) 
x1(n) * [xo(n) + za(n)] = xı (n) * x2(n) + xı (n) * z3(n) : Distribution 
x(n) * (n — no) = x(n — no) : Identity 


1. Analytically prove these properties. 
2. Using the following three sequences, verify the above properties. 


x1(n) = cos(mn/4)[u(n + 5) — u(n — 25)] 
L2(n) = 0. 9)~"[u(n) — u(n — 20)] 
x3(n) = round[5w(n)], —10 < n < 10; where w(n) is uniform over [—1, 1] 
Use the conv_m function. 


P2.15 Determine analytically the convolution y(n) = x(n) * h(n) of the following sequences, and 
verify your answers using the conv_m function. 


x(n) = {2, 4, 5,3, 1, 2, 6}, h(n) = {1, =l; 1, =i, 1} 
T T 
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(n) = {1,1,0,1,1}, h(n) = {1, —2, —3, 4} 
T T 


2. £ 
3. x(n) = (1/4) " [u(n + 1) — u(n — 4)], h(n) = u(n) — u(n — 5) 
4. x(n) = n/4[u(n) — u(n — 6)], h(n) = 2[u(n + 2) — u(n — 3)] 


P2.16 Let x(n) = (0.8)"u(n), h(n) = (—0.9)"u(n), and y(n) = h(n) * a(n). Use 3 columns and 1 
row of subplots for the following parts. 


1. Determine y(n) analytically. Plot first 51 samples of y(n) using the stem function. 

2. Truncate x(n) and h(n) to 26 samples. Use conv function to compute y(n). Plot y(n) 
using the stem function. Compare your results with those of part 1. 

3. Using the filter function, determine the first 51 samples of x(n) x h(n). Plot y(n) using 
the stem function. Compare your results with those of parts 1 and 2. 


P2.17 When the sequences x(n) and h(n) are of finite duration Nz and Np, respectively, then 
their linear convolution (2.13) can also be implemented using matrix-vector multiplication. 
If elements of y(n) and x(n) are arranged in column vectors x and y respectively, then from 
(2.13) we obtain 


y = Hx 


where linear shifts in h(n — k) for n =0,..., Np — 1 are arranged as rows in the matrix H. 
This matrix has an interesting structure and is called a Toeplitz matrix. To investigate this 
matrix, consider the sequences 


a(n) = {1, 2,3, 4,5} and h(n) = {6,7,8,9} 
T i 


1. Determine the linear convolution y(n) = h(n) * x(n). 

2. Express z(n) as a 5 x 1 column vector x and y(n) as a 8 x 1 column vector y. Now 
determine the 8 x 5 matrix H so that y = Hx. 

3. Characterize the matrix H. From this characterization can you give a definition of a 
Toeplitz matrix? How does this definition compare with that of time invariance? 

4. What can you say about the first column and the first row of H? 


P2.18 MATLAB provides a function called toeplitz to generate a Toeplitz matrix, given the first 
row and the first column. 


1. Using this function and your answer to Problem P2.17, part 4, develop another MATLAB 
function to implement linear convolution. The format of the function should be 


function [y,H]=conv_tp(h,x) 
% Linear Convolution using Toeplitz Matrix 


% [y,H] = conv_tp(h,x) 

% y = output sequence in column vector form 

H = Toeplitz matrix corresponding to sequence h so that y = Hx 
% h = Impulse response sequence in column vector form 

x = input sequence in column vector form 


2. Verify your function on the sequences given in Problem P2.17. 
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P2.19 A linear and time-invariant system is described by the difference equation 


y(n) — 0.5y(n — 1) + 0.25y(n — 2) = a(n) + 2z(n — 1) + x(n — 3) 


1. Using the filter function, compute and plot the impulse response of the system over 
0<n< 100. 

2. Determine the stability of the system from this impulse response. 

3. If the input to this system is x(n) = [5 + 3cos(0.27n) + 4sin(0.67n)] u(n), determine the 
response y(n) over 0 < n < 200 using the filter function. 


P2.20 A “simple” digital differentiator is given by 


y(n) = x(n) — a(n — 1) 


which computes a backward first-order difference of the input sequence. Implement this 
differentiator on the following sequences, and plot the results. Comment on the 
appropriateness of this simple differentiator. 


1. x(n) = 5[u(n) — u(n — 20)]: a rectangular pulse 
2. x(n) = n[u(n) — u(n — 10)] + (20 — n) [u(n — 10) — u(n — 20)]: a triangular pulse 


3. x(n) = sin (=) [u(n) — u(n — 100)]: a sinusoidal pulse 
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CHAPTER 


The Discrete-time 
Fourier Analysis 


We have seen how a linear and time-invariant system can be represented 
using its response to the unit sample sequence. This response, called the 
unit impulse response h(n), allows us to compute the system response to 
any arbitrary input x(n) using the linear convolution: 


x(n) — | h(n) |— y(n) = h(n) * a(n) 


This convolution representation is based on the fact that any signal 
can be represented by a linear combination of scaled and delayed unit 
samples. Similarly, we can also represent any arbitrary discrete signal 
as a linear combination of basis signals introduced in Chapter 2. Each 
basis signal set provides a new signal representation. Each representation 
has some advantages and some disadvantages depending upon the type 
of system under consideration. However, when the system is linear and 
time-invariant, only one representation stands out as the most useful. It 
is based on the complex exponential signal set {e/”"} and is called the 
discrete-time Fourier transform. 


3.1 THE DISCRETE-TIME FOURIER TRANSFORM (DTFT) 
—— g 


If x(n) is absolutely summable, that is, $3% |æ(n)| <0, then its discrete- 
time Fourier transform is given by 


X(e) Ê F[a(n)] = Y a(njeo (3.1) 


59 
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The inverse discrete-time Fourier transform (IDTFT) of X(e%”) is given 
by 


w(n) = F-'[X(e!*)] = z f X(e™)e?*" du (3.2) 


The operator F|-] transforms a discrete signal x(n) into a complex-valued 
continuous function X(e!”) of real variable w, called a digital frequency, 
which is measured in radians/sample. 


EXAMPLE 3.1 Determine the discrete-time Fourier transform of x(n) = (0.5)” u(n). 


Solution The sequence x(n) is absolutely summable; therefore its discrete-time Fourier 
transform exists. 


amer" = X Ose 
0 


ji 1 ej” 
sej ea 
OES) e = a= Oe 


-DJe ae 


EXAMPLE 3.2 Determine the discrete-time Fourier transform of the following finite-duration 


sequence: 
a(n) = {1, 2,3, 4,5} 
T 
Solution Using definition (3.1), 
X(e!”) = So a(nje" = era Dib Serie H 4e ben oe 


Since X(e/”) is a complex-valued function, we will have to plot its 
magnitude and its angle (or the real and the imaginary part) with respect 
to w separately to visually describe X(e7”). Now w is a real variable 
between —oo and oo, which would mean that we can plot only a part of the 
X(e!”) function using MATLAB. Using two important properties of the 
discrete-time Fourier transform, we can reduce this domain to the [0,7] 
interval for real-valued sequences. We will discuss other useful properties 
of X(e%”) in the next section. 


3.1.1 TWO IMPORTANT PROPERTIES 
We will state the following two properties without proof. 
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1. Periodicity: The discrete-time Fourier transform X(e’”) is periodic 
in w with period 27. 
Keyan) 
Implication: We need only one period of X(e%”) (i.e., w €[0, 27], or 
[—1,7], etc.) for analysis and not the whole domain —œ < w < oo. 
2. Symmetry: For real-valued x(n), X(e%”) is conjugate symmetric. 


X (eH) = X* (e) 


or 


II 


Re[X(e”)] (even symmetry) 
= —Im[X(e”)] (odd symmetry) 
|X(e~"")| = |X(e"*)| (even symmetry) 
LX(e3”) = —LX(e!”) (odd symmetry) 


Implication: To plot X(e%”), we now need to consider only a half 
period of X(e%”). Generally, in practice this period is chosen to be 
w € [0,7]. 


3.1.2 MATLAB IMPLEMENTATION 
If x(n) is of infinite duration, then MATLAB cannot be used directly 
to compute X(e%”) from x(n). However, we can use it to evaluate the 
expression X(e/”) over [0,7] frequencies and then plot its magnitude and 
angle (or real and imaginary parts). 


EXAMPLE 3.3 Evaluate X(e“”) in Example 3.1 at 501 equispaced points between [0,7] and 
plot its magnitude, angle, real, and imaginary parts. 


Solution MATLAB script: 


>> w = [0:1:500]*pi/500; % [0, pi] axis divided into 501 points. 

>> X = exp(j*w) ./ (exp(j*w) - 0.5*ones(1,501)); 

>> magX = abs(X); angX = angle(X); realX = real(X); imagX = imag(X); 

>> subplot(2,2,1); plot(w/pi,magX); grid 

>> xlabel(’frequency in pi units’); title(’Magnitude Part’); ylabel(’Magnitude’ ) 
>> subplot (2,2,3); plot(w/pi,angX); grid 

>> xlabel(’frequency in pi units’); title(’Angle Part’); ylabel(’Radians’ ) 

>> subplot (2,2,2); plot(w/pi,realX); grid 

>> xlabel(’frequency in pi units’); title(’Real Part’); ylabel(’Real’) 

>> subplot (2,2,4); plot(w/pi,imagX); grid 

>> xlabel(’frequency in pi units’); title(’Imaginary Part’); ylabel(’ Imaginary’ ) 
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FIGURE 3.1 Plots in Example 3.3 


The resulting plots are shown in Figure 3.1. Note that we divided the w array by 
pi before plotting so that the frequency axes are in the units of m and therefore 
easier to read. This practice is strongly recommended. 


If x(n) is of finite duration, then MATLAB can be used to compute 
X(e/”) numerically at any frequency w. The approach is to implement 
(3.1) directly. If, in addition, we evaluate X(e%”) at equispaced frequen- 
cies between [0, 7], then (3.1) can be implemented as a matrix-vector mul- 
tiplication operation. To understand this, let us assume that the sequence 
x(n) has N samples between nı < n < ny (i-e., not necessarily between 
[0, N — 1]) and that we want to evaluate X(e!”) at 

AT 
we = gb &=0,1,...,M 
which are (M + 1) equispaced frequencies between [0,7]. Then (3.1) can 
be written as 


N 
X (eit) = De Mma(ng), k= 0,1,...,M 
l=1 
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When {a (ne)} and {X(e/“*)} are arranged as column vectors x and X, 
respectively, we have 
X = Wx (3.3) 


where W is an (M +1) x N matrix given by 


ws Cou ny <n<nn, k=0,1,...,M} 


In addition, if we arrange {k} and {nz} as row vectors k and n respectively, 
then 


w- [aw (e"o) 


In MATLAB we represent sequences and indices as row vectors; therefore 
taking the transpose of (3.3), we obtain 


XT =x? [exp (-s5n7k)| (3.4) 


Note that nfk is an N x (M + 1) matrix. Now (3.4) can be implemented 
in MATLAB as follows. 


>> k 
>> X 


[0:M]; n = [n1:n2]; 
x * (exp(-j*pi/M)) .^ (n’*k); 


EXAMPLE 3.4 Numerically compute the discrete-time Fourier transform of the sequence x(n) 
given in Example 3.2 at 501 equispaced frequencies between [0, 7]. 


Solution MATLAB script: 


>> n = -1:3; x = 1:5; k = 0:500; w = (pi/500)*k; 

>> X = x * (exp(-j*pi/500)) .~ (n’*k); 

>> magX = abs(X); angX = angle(X); 

>> realX = real(X); imagX = imag(X); 

>> subplot(2,2,1); plot(k/500,magX) ; grid 

>> xlabel(’frequency in pi units’); title(’Magnitude Part’) 
>> subplot (2,2,3); plot (k/500,angX/pi) ;grid 

>> xlabel(’frequency in pi units’); title(’Angle Part’) 

>> subplot (2,2,2); plot(k/500,realX) ;grid 

>> xlabel(’frequency in pi units’); title(’Real Part’) 

>> subplot (2,2,4); plot (k/500,imagX) ; grid 

>> xlabel(’frequency in pi units’); title(’Imaginary Part’) 


The frequency-domain plots are shown in Figure 3.2. Note that the angle plot 
is depicted as a discontinuous function between —7z and 7. This is because the 
angle function in MATLAB computes the principal angle. 
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FIGURE 3.2 Plots in Example 3.4 


The procedure of Example 3.4 can be compiled into a MATLAB func- 
tion, say a dtft function, for ease of implementation. This is explored in 
Problem P3.1. This numerical computation is based on definition (3.1). 
It is not the most elegant way of numerically computing the discrete- 
time Fourier transform of a finite-duration sequence. In Chapter 5 we 
will discuss in detail the topic of a computable transform called the dis- 
crete Fourier transform (DFT) and its efficient computation called the 
fast Fourier transform (FFT). Also there is an alternate approach based 
on the z-transform using the MATLAB function freqz, which we will dis- 
cuss in Chapter 4. In this chapter we will continue to use the approaches 
discussed so far for calculation as well as for investigation purposes. 

In the next two examples we investigate the periodicity and symmetry 
properties using complex-valued and real-valued sequences. 


EXAMPLE 3.5 Let a(n) = (0.9exp (jz/3))”, 0 < n < 10. Determine X(e%”) and investigate 
its periodicity. 


Solution Since a(n) is complex-valued, X(e?”) satisfies only the periodicity property. 
Therefore it is uniquely defined over one period of 27. However, we will evaluate 
and plot it at 401 frequencies over two periods between [—27, 27] to observe its 
periodicity. 
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FIGURE 3.3 Plots in Example 3.5 


MATLAB script: 


>> n = 0:10; x = (0.9*exp(j*pi/3)) .“n; 

>> k = -200:200; w = (pi/100)*k; 

>> X = x * (exp(-j*pi/100)) .~ (n’*k); 

>> magX = abs(X); angX =angle(X) ; 

>> subplot(2,1,1); plot(w/pi,magX) ;grid 

>> xlabel(’frequency in units of pi’); ylabel(’ |X|’) 

>> title(’Magnitude Part’) 

>> subplot (2,1,2); plot(w/pi,angX/pi) ;grid 

>> xlabel(’frequency in units of pi’); ylabel(’radians/pi’ ) 
>> title(’Angle Part’) 


From the plots in Figure 3.3 we observe that X(e?”) is periodic in w but is not 
conjugate-symmetric. 


EXAMPLE 3.6 Let x(n) = (0.9)”, —10 < n < 10. Investigate the conjugate-symmetry property 
of its discrete-time Fourier transform. 
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FIGURE 3.4 Plots in Example 3.6 


Solution Once again we will compute and plot X(e?”) over two periods to study its 
symmetry property. 


MATLAB script: 


SS im = Habs se S (0.8). ae 

>> k = -200:200; w = (pi/100)*k; X = x * (exp(-j*pi/100)) .^ (m’*k); 
>> magX = abs(X); angX =angle(X) ; 

>> subplot(2,1,1); plot(w/pi,magX);grid; axis([-2,2,0,15]) 

>> xlabel(’frequency in units of pi’); ylabel(’ |X|’) 

>> title(’Magnitude Part’) 

>> subplot (2,1,2); plot(w/pi,angX/pi);grid; axis([-2,2,-1,1]) 

>> xlabel(’frequency in units of pi’); ylabel(’radians/pi’ ) 

>> title(’Angle Part’) 


From the plots in Figure 3.4 we observe that X(e’”) is not only periodic in w 
but is also conjugate-symmetric. Therefore for real sequences we will plot their 
Fourier transform magnitude and angle graphs from 0 to mr. 


3.1.3 SOME COMMON DTFT PAIRS 
The discrete-time Fourier transforms of the basic sequences discussed in 
Chapter 2 are very useful. The discrete-time Fourier transforms of some 
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TABLE 3.1 Some common DTFT pairs 


Signal Type Sequence x(n) DTFT ie"), —T<w<t 
Unit impulse 6(n) 1 
Constant 1 276(w) 
; 1 
Unit step u(n) — 0 + 16(w) 
1 
Causal exponential a”u(n) 
1 —aeJ¥ 

Complex exponential ejwon 276(w — wo) 
Cosine cos(won) T[6(w — wo) + 6(w + wo)] 
Sine sin(won) gm [6(w + wo) — 6(w — wo)| 

. 1-a? 
Double exponential al"lu(n) 


1 — 2acos(w) + a? 


Note: Since X (ec!) is periodic with period 27, expressions over only 
the primary period of —r < w < m are given. 


of these sequences can be easily obtained using the basic definitions (3.1) 
and (3.2). These transform pairs and those of few other pairs are given 
in Table 3.1. Note that, even if sequences like unit step u(n) are not 
absolutely summable, their discrete-time Fourier transforms exist in the 
limiting sense if we allow impulses in the Fourier transform. Such se- 
quences are said to have finite power, that is, >, |x(n)|? < oo. Using 
this table and the properties of the Fourier transform (discussed in Sec- 
tion 3.2), it is possible to obtain discrete-time Fourier transform of many 
more sequences. 


3.2 THE PROPERTIES OF THE DTFT 
ee Cae 


In the previous section, we discussed two important properties that 
we needed for plotting purposes. We now discuss the remaining useful 
properties, which are given below without proof. Let X(e%”) be the 
discrete-time Fourier transform of x(n). 


1. Linearity: The discrete-time Fourier transform is a linear transforma- 
tion; that is, 


F (aax1(n) + Bx2(n)| = aF [x1(n)] + BF [xz2(n)] (3.5) 


for every a, 3, x(n), and x(n). 
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2. Time shifting: A shift in the time domain corresponds to the phase 
shifting. 


F [x(n — k)] = X(e%”)e~5e* (3.6) 


3. Frequency shifting: Multiplication by a complex exponential corre- 
sponds to a shift in the frequency domain. 


F [x(n)e9%0"] = X (e140) (3.7) 


4. Conjugation: Conjugation in the time domain corresponds to the 
folding and conjugation in the frequency domain. 


F |x*(n)] = X*(e79") (3.8) 


5. Folding: Folding in the time domain corresponds to the folding in the 
frequency domain. 


F [x(—n)] = X(e73”) (3.9) 


6. Symmetries in real sequences: We have already studied the conju- 
gate symmetry of real sequences. These real sequences can be decom- 
posed into their even and odd parts, as discussed in Chapter 2. 


x(n) = re(n) + x(n) 


Then 


F [xe(n)] = Re [X(e%”)] 
l (3.10) 
F |xo(n)] = j Im [X(e3)] 


Implication: If the sequence x(n) is real and even, then X(ef®) is 
also real and even. Hence only one plot over [0,7] is necessary for its 
complete representation. 

A similar property for complex-valued sequences is explored in 
Problem P3.7. 


7. Convolution: This is one of the most useful properties that makes 
system analysis convenient in the frequency domain. 


F [x1(n) * 22(n)] = F [21(n)] F [w2(n)] = Xi(e™*)X2(e) (3.11) 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


The Properties of the DTFT 69 


8. Multiplication: This is a dual of the convolution property. 


F [x1(n)-22(n)] = F [x1(n)]@ Flez(n)] S EN 


~ On 


X(t) Xa (Ido 


= 


(3.12) 


This convolution-like operation is called a periodic convolution and 
hence denoted by &. It is discussed (in its discrete form) in 
Chapter 5. 


9. Energy: The energy of the sequence x(n) can be written as 


E = YP = = f Ka (3.13) 


T J 
|X (e1°)]|? : 
= | —=dw (for real sequences using even symmetry) 
T 
0 
This is also known as Parseval’s theorem. From (3.13) the energy den- 
sity spectrum of z(n) is defined as 
A |X(e*)/? 
= T 


®,(w) (3.14) 


Then the energy of x(n) in the [w1, w2] band is given by 
w2 
®,(w)dw, O<w <w <T 
wi 

In the next several examples we will verify some of these properties 
using finite-duration sequences. We will follow our numerical procedure 
to compute discrete-time Fourier transforms in each case. Although this 
does not analytically prove the validity of each property, it provides us 
with an experimental tool in practice. 


EXAMPLE 3.7 In this example we will verify the linearity property (3.5) using real-valued finite- 
duration sequences. Let xı(n) and x2(n) be two random sequences uniformly 
distributed between [0,1] over 0 < n < 10. Then we can use our numerical 
discrete-time Fourier transform procedure as follows. 


MATLAB script: 


>> x1 = rand(1,11); x2 = rand(1,11); n = 0:10; 

>> alpha = 2; beta = 3; k = 0:500; w = (pi/500)*k; 

>> X1 = x1 * (exp(-j*pi/500))."(n’*k); % DTFT of x1 

>> X2 = x2 * (exp(-j*pi/500)).“(n’*k); % DTFT of x2 

>> x = alpha*xi + beta*x2; % Linear combination of x1 & x2 
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>> X = x * (exp(-j*pi/500)) .~(m’*k) ; % DTFT of x 
>> % verification 
>> X_check = alpha*Xi + beta*X2; % Linear Combination of X1 & X2 
>> error = max(abs(X-X_check) ) % Difference 
error = 
7.1054e-015 


Since the maximum absolute error between the two Fourier transform arrays 
is less than 10714, the two arrays are identical within the limited numerica 
precision of MATLAB. 


EXAMPLE 3.8 Let x(n) be a random sequence uniformly distributed between [0,1] over 0 < 
n < 10 and let y(n) = a(n — 2). Then we can verify the sample shift property 
(3.6) as follows. 


>> x = rand(1,11); n = 0:10; 

>> k = 0:500; w = (pi/500) *k; 

>> x * (exp(-j*pi/500)) .*(n’*k); % DTFT of x 
>> % signal shifted by two samples 

SS Vv = SR il = ie 


ps 
Il 


>> Y = y * (exp(-j*pi/500)).^(m’*k); % DTFT of y 
>> % verification 
>> Y_check = (exp(-j*2).“w) .*X; % multiplication by exp(-j2w) 
>> error = max(abs(Y-Y_check) ) % Difference 
error = 
5.7737e-015 


EXAMPLE 3.9 To verify the frequency shift property (3.7), we will use the graphical approach. 
Let 


x(n) = cos(7n/2), O<n< 100 and y(n) = e'""/42(n) 
Then using MATLAB, 


>> n = 0:100; x = cos(pixtn/2) ; 

>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi 

>> X = x * (exp(-j*pi/100)) .*(m’*k) ; % DTFT of x 

hh 

>> y = exp(j*pixn/4) .*x; % signal multiplied by exp(j*pi*n/4) 
>> Y = y * (exp(-j*pi/100)) .*(n’*k) ; % DTFT of y 


% Graphical verification 

>> subplot(2,2,1); plot(w/pi,abs(X)); grid; axis([-1,1,0,60]) 

>> xlabel(’frequency in pi units’); ylabel(’|X|’) 

>> title(’Magnitude of X’) 

>> subplot (2,2,2); plot(w/pi,angle(X)/pi); grid; axis([-1,1,-1,1]) 
>> xlabel(’frequency in pi units’); ylabel(’radiands/pi’ ) 

>> title(’Angle of X’) 

>> subplot (2,2,3); plot(w/pi,abs(Y)); grid; axis([-1,1,0,60]) 
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FIGURE 3.5 Plots in Example 3.9 


>> xlabel(’frequency in pi units’); ylabel(’|Y|’) 

>> title(’Magnitude of Y’) 

>> subplot (2,2,4); plot(w/pi,angle(Y)/pi); grid; axis([-1,1,-1,1]) 
>> xlabel(’frequency in pi units’); ylabel(’radians/pi’ ) 

>> title(’Angle of Y’) 


From the plots in Figure 3.5, we observe that X(e”) is indeed shifted by 1/4 
in both magnitude and angle. 


EXAMPLE 3.10 ‘To verify the conjugation property (3.8), let x(n) be a complex-valued random 
sequence over —5 < n < 10 with real and imaginary parts uniformly distributed 
between [0,1]. The MATLAB verification is as follows. 


>> n = -5:10; x = rand(1,length(m)) + j*rand(1,length(n)) ; 

>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi 
>> X = x * (exp(-j*pi/100)) .*(m’*k) ; % DTFT of x 

% conjugation property 

>> y = conj(x); % signal conjugation 

>> Y = y * (exp(-j*pi/100)) .*(n’*k) ; % DTFT of y 


% verification 
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>> Y_check = conj(fliplr(X)) ; % conj (X(-w)) 
>> error = max(abs(Y-Y_check) ) %, Difference 
error = 

0 


EXAMPLE 3.11 To verify the folding property (3.9), let x(n) be a random sequence over —5 < 
n < 10 uniformly distributed between [0,1]. The MATLAB verification is as 
follows. 


>> n = -5:10; x = rand(1,length(n)) ; 
>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi 
>> X = x * (exp(-j*pi/100)) .~(m’*k) ; % DTFT of x 
% folding property 
>> y = fliplr(x); m = -fliplr(n); % signal folding 
>> Y = y * (exp(-j*pi/100)) .*(m’*k) ; % DIFT of y 
% verification 
>> Y_check = fliplr(X); h X(-w) 
>> error = max(abs(Y-Y_check) ) %, Difference 
error = 
0 


EXAMPLE 3.12 In this problem we verify the symmetry property (3.10) of real signals. Let 
x(n) = sin(rn/2), -—5<n< 10 


Then using the evenodd function developed in Chapter 2, we can compute 
the even and odd parts of x(n) and then evaluate their discrete-time Fourier 
transforms. We will provide the numerical as well as graphical verification. 


MATLAB script: 


>> n = -5:10; x = sin(pix*n/2) ; 


>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi 
>> X = x * (exp(-j*pi/100)) .*(m’*k) ; % DTFT of x 

% signal decomposition 

>> [xe,xo,m] = evenodd(x,n); % even and odd parts 


>> XE = xe * (exp(-j*pi/100)).~(m’*k); % DTFT of xe 
>> XO = xo * (exp(-j*pi/100)).*(m’*k); % DTFT of xo 
% verification 


>> XR = real(X); % real part of X 
>> errori = max(abs(XE-XR)) % Difference 
errori = 

1.8974e-019 
>> XI = imag(X); % imag part of X 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


The Properties of the DTFT 73 


Real part of X Imaginary part of X 
2 
1 : 
S 
o 
(a 
-1 
2 
-1 —0.5 0 0.5 1 -1 -0.5 0 0.5 1 
frequency in m units frequency in m units 
Transform of even part Transform of odd part 
2 10 
1 5 
Yoo Q o 
-1 -5 
2 10 
-1 -0.5 0 0.5 1 -1 -0.5 0 0.5 1 
frequency in m units frequency in m units 


FIGURE 3.6 Plots in Example 3.12 


>> error2 = max(abs(X0-j*XI) ) % Difference 
error2 = 
1.8033e-019 


% graphical verification 

>> subplot (2,2,1); plot (w/pi,XR); grid; axis([-1,1,-2,2]) 

>> xlabel(’frequency in pi units’); ylabel(’Re(X)’); 

>> title(’Real part of X’) 

>> subplot (2,2,2); plot(w/pi,XI); grid; axis([-1,1,-10,10]) 

>> xlabel(’ frequency in pi units’); ylabel(’Im(X)’); 

>> title(’ Imaginary part of X’) 

>> subplot (2,2,3); plot(w/pi,real(XE)); grid; axis([-1,1,-2,2]) 
>> xlabel(’frequency in pi units’); ylabel(’XE’); 

>> title(’Transform of even part’) 

>> subplot(2,2,4); plot(w/pi,imag(X0)); grid; axis([-1,1,-10,10]) 
>> xlabel(’frequency in pi units’); ylabel(’X0’); 

>> title(’Transform of odd part’) 


From the plots in Figure 3.6 we observe that the real part of X(e’”) [or the 
imaginary part of X(e’”)] is equal to the discrete-time Fourier transform o. 
Xe(n) [or xo(n)]. 
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3.3 THE FREQUENCY DOMAIN REPRESENTATION 


OF LTI SYSTEMS 
—— 


We earlier stated that the Fourier transform representation is the most 
useful signal representation for LTI systems. It is due to the following 
result. 


3.3.1 RESPONSE TO A COMPLEX EXPONENTIAL e#2” 
Let x(n) = ef”0” be the input to an LTI system represented by the impulse 
response h(n). 


eJvor — | h(n) | — h(n) x eo” 


Then 


y(n) = h(n) x ejon — 5y h(k)eF70("—*) 


È naese ejvon (3.15) 


mM  DEFINITION1 [Frequency Response] The discrete-time Fourier transform of an impulse 
response is called the frequency response (or transfer function) of an LTI 
system and is denoted by 


H(c") Ê Y h(n)e™ten (3.16) 


Then from (3.15) we can represent the system by 


a(n) = 2 — | H (e2) | — y(n) = H (e1) x e70 (3.17) 


Hence the output sequence is the input exponential sequence modified by 
the response of the system at frequency wo. This justifies the definition 
of H(ef®) as a frequency response because it is what the complex expo- 
nential is multiplied by to obtain the output y(n). This powerful result 
can be extended to a linear combination of complex exponentials using 
the linearity of LTI systems. 


DD Apel” —s h(n) | — 5 ApH (e?”*) eleRn 
k k 
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In general, the frequency response H(e”) is a complex function of 
w. The magnitude |H(e?”)| of H(e?”) is called the magnitude (or gain) 
response function, and the angle /H(e%”) is called the phase response 
function as we shall see below. 


3.3.2 RESPONSE TO SINUSOIDAL SEQUENCES 
Let x(n) = Acos(won + ĝo) be an input to an LTI system h(n). Then 
from (3.17) we can show that the response y(n) is another sinusoid of the 
same frequency wo, with amplitude gained by |H(e’*°)| and phase shifted 
by ZH(e?“°), that is, 

y(n) = A|H(e?”°)| cos(won + 0o + ZH(e3”°)) (3.18) 
This response is called the steady-state response, denoted by yss(n). It 
can be extended to a linear combination of sinusoidal sequences. 

D Ax cos(win + 0x) — | H(t) | — Dy Arl A (el) 
k 


cos(wpn + Ok + LH (e3”*)) 


3.3.3 RESPONSE TO ARBITRARY SEQUENCES 
Finally, (3.17) can be generalized to arbitrary absolutely summable se- 
quences. Let X(e/”) = Flax(n)| and Y(e/”) = F[y(n)]; then using the 
convolution property (3.11), we have 

Y(e3”) = H(t”) X(e?”) (3.19) 
Therefore an LTI system can be represented in the frequency domain by 


X (eo) — | H(e*) | — Y (e) = H(e™) X (e°) 


The output y(n) is then computed from Y(e%”) using the inverse 
discrete-time Fourier transform (3.2). This requires an integral operation, 
which is not a convenient operation in MATLAB. As we shall see in 
Chapter 4, there is an alternate approach to the computation of output to 
arbitrary inputs using the z-transform and partial fraction expansion. In 
this chapter we will concentrate on computing the steady-state response. 


EXAMPLE 3.13 Determine the frequency response H(e!”) of a system characterized by h(n) = 
(0.9)"u(n). Plot the magnitude and the phase responses. 


Solution Using (3.16), 
HES > he? => (0.9) e" 
— o0 0 
ua TJW\N __ 
= B = age 
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Hence 
H(e’”)| = = 
rai Ja — 0.9 cos w)? + (0.9 sin w)? 1.81 — 1.8 cos w 
and 
j 0.9 sin w 
jwy _ 
NE) ence li — 0.9 e 


To plot these responses, we can either implement the |H(e?”)| and ZH (e°) 
functions or the frequency response H(e”) and then compute its magnitude 
and phase. The latter approach is more useful from a practical viewpoint [as 
shown in (3.18)]. 


>> w = [0:1:500]*pi/500; % [0, pi] axis divided into 501 points. 
>> H = exp(j*w) ./ (exp(j*w) - 0.9*ones(1,501)); 

>> magH = abs(H); angH = angle(H); 

>> subplot(2,1,1); plot(w/pi,magH); grid; 

>> xlabel(’frequency in pi units’); ylabel(’|HI’); 

>> title(’Magnitude Response’) ; 

>> subplot(2,1,2); plot(w/pi,angH/pi); grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi Radians’); 
>> title(’Phase Response’) ; 


The plots are shown in Figure 3.7. 


EXAMPLE 3.14 Let an input to the system in Example 3.13 be 0.1u(n). Determine the steady- 
state response yss5(7). 


Solution Since the input is not absolutely summable, the discrete-time Fourier transform 
is not particularly useful in computing the complete response. However, it can 
be used to compute the steady-state response. In the steady state (i.e., n — oo), 
the input is a constant sequence (or a sinusoid with wo = ĝo = 0). Then the 
output is 


Yss(n) = 0.1 x H(e”) =0.1x 10=1 


where the gain of the system at w = 0 (also called the DC gain) is H(e?°) = 10, 
which is obtained from Figure 3.7. 


3.3.4 FREQUENCY RESPONSE FUNCTION FROM DIFFERENCE EQUA- 
TIONS 
When an LTI system is represented by the difference equation 


N M 
v(n) + Yraey(n= 0) = J bast(n — mn) (3.20) 
l=1 m=0 
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FIGURE 3.7 Frequency response plots in Example 3.13 


then to evaluate its frequency response from (3.16), we would need the im- 
pulse response h(n). However, using (3.17), we can easily obtain H(e?”). 
We know that when z(n) = e/”", then y(n) must be H(e?”)e7”". Substi- 
tuting in (3.20), we have 


He)" > aH e}®) eI n—€) > bm Para n—m) 
g=] 


or S Wo gi 

H(t) = Ar T (3.21) 
1+ Jez e eie 

after canceling the common factor e/”” term and rearranging. This equa- 

tion can easily be implemented in MATLAB, given the difference equation 


parameters. 


EXAMPLE 3.15 An LTI system is specified by the difference equation 


y(n) = 0.8y(n — 1) + x(n) 


a. Determine H (ef®). 
b. Calculate and plot the steady-state response yss(n) to 


x(n) = cos(0.057n) u(n) 
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Solution Rewrite the difference equation as y(n) — 0.8y(n — 1) = x(n). 


a. Using (3.21), we obtain 

= 1 

© 1-0.8e75+ 

b. In the steady state the input is x(n) = cos(0.057n) with frequency wo = 
0.057 and ĝo = 0°. The response of the system is 


1 
1 — 0.8¢e—50.057 


H(t”) (3.22) 


H (e0257) RR _ 4.0928e 770-5377 


Therefore 
Yss(n) = 4.0928 cos(0.057n — 0.5377) = 4.0928 cos [0.057 (n — 3.42)] 


This means that at the output the sinusoid is scaled by 4.0928 and shifted 
by 3.42 samples. This can be verified using MATLAB. 


>> subplot(1,1,1) 

>> b = 1; a = [1,-0.8]; 

>> n=[0:100];x = cos(0.05*pi*n); 

>> y = filter(b,a,x); 

>> subplot(2,1,1); stem(n,x); 

>> xlabel(’n’); ylabel(’x(n)’); title(’Input sequence’) 
>> subplot(2,1,2); stem(n,y); 

>> xlabel(’n’); ylabel(’y(n)’); title(’Output sequence’) 


From the plots in Figure 3.8, we note that the amplitude of yss(n) is approx- 
imately 4. To determine the shift in the output sinusoid, we can compare 
zero crossings of the input and the output. This is shown in Figure 3.8, from 
which the shift is approximately 3.4 samples. 


In Example 3.15 the system was characterized by a Ist-order dif- 
ference equation. It is fairly straightforward to implement (3.22) in 
MATLAB as we did in Example 3.13. In practice the difference equations 
are of large order and hence we need a compact procedure to implement 
the general expression (3.21). This can be done using a simple matrix- 
vector multiplication. If we evaluate H(e?”) at k =0,1,...,K equispaced 
frequencies over [0,7], then 

M —jwpm 
H(ei**) = 2 m=0bm C o Reen K (3.23) 
1+ Jp] ae em Jen? 


If we let {bm}, {ac} (with ao = 1), {m = 0,..., M}, {€=0,...,N}, and 
{wp} be arrays (or row vectors), then the numerator and the denominator 
of (3.23) become 


bexp(—jm"w); aexp(—jl"w) 
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FIGURE 3.8 Plots in Example 3.15 


respectively. Now the array H(e/“*) in (3.23) can be computed using a ./ 
operation. This procedure can be implemented in a MATLAB function to 
determine the frequency response function, given {bm} and {ae} arrays. 
We will explore this in Example 3.16 and in Problem P3.16. 


EXAMPLE 3.16 A 3rd-order lowpass filter is described by the difference equation 
y(n) = 0.0181a(n) + 0.0543a(n — 1) + 0.0543a(n — 2) + 0.0181a(n — 3) 
+1.76y(n — 1) — 1.1829y(n — 2) + 0.2781 y(n — 3) 


Plot the magnitude and the phase response of this filter, and verify that it is a 
lowpass filter. 


Solution We will implement this procedure in MATLAB and then plot the filter 
responses. 
>> b = [0.0181, 0.0543, 0.0543, 0.0181]; % filter coefficient array b 
>> a = [1.0000, -1.7600, 1.1829, -0.2781]; % filter coefficient array a 
>> m = O:length(b)-1; 1 = O:length(a)-1;  % index arrays m and 1 
>> K = 500; k = 0:1:K; % index array k for frequencies 
>> w = pi*k/K; % [0, pi] axis divided into 501 points. 
>> num = b * exp(-j*m’*w) ; % Numerator calculations 
>> den = a * exp(-j*1’*w); % Denominator calculations 
>> H = num ./ den; % Frequency response 
>> magH = abs(H); angH = angle(H); % mag and phase responses 
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FIGURE 3.9 Plots for Example 3.16 


>> subplot(2,1,1); plot(w/pi,magH); grid; axis([0,1,0,1]) 

>> xlabel(’frequency in pi units’); ylabel(’|HI’); 

>> title(’Magnitude Response’); 

>> subplot (2,1,2); plot(w/pi,angH/pi); grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi Radians’); 
>> title(’Phase Response’); 


From the plots in Figure 3.9 we see that the filter is indeed a lowpass filter. 


3.4 SAMPLING AND RECONSTRUCTION OF ANALOG SIGNALS 
—— gp 


In many applications—for example, in digital communications—real- 
world analog signals are converted into discrete signals using sampling 
and quantization operations (collectively called analog-to-digital con- 
version, or ADC). These discrete signals are processed by digital signal 
processors, and the processed signals are converted into analog signals 
using a reconstruction operation (called digital-to-analog conversion or 
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DAC). Using Fourier analysis, we can describe the sampling operation 
from the frequency-domain viewpoint, analyze its effects, and then ad- 
dress the reconstruction operation. We will also assume that the number 
of quantization levels is sufficiently large that the effect of quantization 
on discrete signals is negligible. We will study the effects of quantization 
in Chapter 10. 


3.4.1 SAMPLING 
Let x(t) be an analog (absolutely integrable) signal. Its continuous-time 
Fourier transform (CTFT) is given by 
œ Â —jNt 
E if salte idt (3.24) 
where Q is an analog frequency in radians/sec. The inverse continuous- 
time Fourier transform is given by 


zalt) = = | Xa lji dN (3.25) 


<00 
We now sample za(t) at sampling interval Ts seconds apart to obtain the 
discrete-time signal x(n). 
A 
x(n) = zal nT) 


Let X(e%”) be the discrete-time Fourier transform of x(n). Then it can be 
shown [23] that X(e!”) is a countable sum of amplitude-scaled, frequency- 
scaled, and translated versions of the Fourier transform X,(jQ). 


X(e3”) = T Xa b (= 2 e) (3.26) 


This relation is known as the aliasing formula. The analog and digital 
frequencies are related through T, 


w= OT, (3.27) 
while the sampling frequency F, is given by 
1 
F, £ T sam /sec (3.28) 


The graphical illustration of (3.26) is shown in Figure 3.10, from which 
we observe that, in general, the discrete signal is an aliased version of the 
corresponding analog signal because higher frequencies are aliased into 
lower frequencies if there is an overlap. However, it is possible to recover 
the Fourier transform X,(jQ) from X(e/”) [or equivalently, the analog 
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x,(t) XUA) 
1 A 
CTFT A+ 
= 
>t > 
0 =O 0 Ge n 
[ee a (3.27) 
X(e/®) 
xun) AIT, | 
1 
/ \ DTFT 
—p 
Ts < T/g 
l \ fi -Qy/T, Qo/T. 
cv N olls o'ls 
EN. i if A = | | -o 
-5 Ip. 0 I f5 -2n -r 0 n 2x 
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FIGURE 3.10 Sampling operation in the time and frequency domains 


signal x,(t) from its samples z(n)] if the infinite “replicas” of Xq(jQ) do 
not overlap with each other to form X(e/”). This is true for band-limited 
analog signals. 


DEFINITION 2 [Band-limited Signal] A signal is band-limited if there exists a finite ra- 
dian frequency Qo such that Xa (jQ) is zero for |Q| > Qo. The frequency 
Fo=Q0/27 is called the signal bandwidth in Hz. 
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Referring to Figure 3.10, if r > QoTs—or equivalently, F, /2 > Fo— 
then 


; 1 w T w T 
Je) = j A < i 
X(@”) X (: J T, < T, T, (3.29) 


which leads to the sampling theorem for band-limited signals. 


E THEOREM3 Sampling Principle 
A band-limited signal x(t) with bandwidth Fo can be reconstructed from 
its sample values x(n) = aq(nT,) if the sampling frequency F; = 1/T, is 
greater than twice the bandwidth Fo of xq(t). 


F, > 2Fy 


Otherwise aliasing would result in x(n). The sampling rate of 2Fo for an 
analog band-limited signal is called the Nyquist rate. 


Note: After za(t) is sampled, the highest analog frequency that x(n) rep- 
resents is F,/2 Hz (or w = 7). This agrees with the implication stated in 
property 2 of the discrete-time Fourier transform in Section 3.1. Before 
we delve into MATLAB implementation of sampling, we first consider 
sampling of sinusoidal signals and the resulting Fourier transform in the 
following example. 


EXAMPLE 3.17 The analog signal xa(t) = 4 + 2cos(1507t + 7/3) + 4sin(3507t) is sampled at 
Fs = 200 sam/sec to obtain the discrete-time signal x(n). Determine x(n) and 
its corresponding DTFT X(e?”). 


Solution The highest frequency in the given xa(t) is Fo = 175 Hz. Since F, = 200, which 
is less than 2Fo, there will be aliasing in x(n) after sampling. The sampling 
interval is T; = 1/F = 0.005 sec. Hence we have 


x(n) = £a(nT,) = £a(0.005n) 


= 4+2cos (0.7500 + z) + 4sin(1.757n) (3.30) 


Note that the digital frequency, 1.757, of the third term in (3.30) is outside the 
primary interval of —7 < w < 7, signifying that aliasing has occurred. From 
the periodicity property of digital sinusoidal sequences in Chapter 2, we know 
that the period of the digital sinusoid is 27. Hence we can determine the alias 
of the frequency 1.757. From (3.30) we have 


x(n) = 44 2cos(0.757n + 3) + 4sin(1.75an — 27n) 


4 + 2cos(0.75rn + 2) — 4sin(0.257n) (3.31) 
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Using Euler’s identity, we can expess x(n) as 
a(n) =A ef7/3 050-7500 + e 58/3 e710 T5Tn jer esnin _ een (3.32) 
From Table 3.1 and the DTFT properties, the DTFT of x(n) is given by 


X(t) = 8rô(w) + 2ne!"/35(w — 0.757) + 2ne 27/76(w + 0.757) 


+ j4ró(w — 0.257) — j4rô(w + 0.257), =r <w <m. (3.33) 


The plot of X(e’”) is shown in Figure 3.15. 


3.4.2 MATLAB IMPLEMENTATION 

In a strict sense it is not possible to analyze analog signals using MATLAB 
unless we use the Symbolic toolbox. However, if we sample £a(t) on a fine 
grid that has a sufficiently small time increment to yield a smooth plot 
and a large enough maximum time to show all the modes, then we can 
approximate its analysis. Let At be the grid interval such that At < 7. 
Then 


zalm) Ê x_(mAt) (3.34) 


can be used as an array to simulate an analog signal. The sampling in- 
terval T; should not be confused with the grid interval At, which is used 
strictly to represent an analog signal in MATLAB. Similarly, the Fourier 
transform relation (3.24) should also be approximated in light of (3.34) 
as follows: 


Xa(JQ) ~ X salm) eist At = At ra(m)e ®t (3.35) 


Now if xq(t) [and hence xg(m)] is of finite duration, then (3.35) is similar 
to the discrete-time Fourier transform relation (3.3) and hence can be 
implemented in MATLAB in a similar fashion to analyze the sampling 
phenomenon. 


EXAMPLE 3.18 Let za(t) = e 10ltl | Determine and plot its Fourier transform. 


Solution From (3.24) 
oo 0 (e) 
Xa(jQ) = n zalt) idt — J ee a etde 
a Žo 0 
.002 
= ee (3.36) 
1+ (4550) 
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which is a real-valued function since x(t) is a real and even signal. To evaluate 
Xa(jQ) numerically, we have to first approximate xa(t) by a finite-duration 
grid sequence xg(m). Using the approximation e~° ~ 0, we note that x(t) 
can be approximated by a finite-duration signal over —0.005 < t < 0.005 (or 
equivalently, over [—5,5] msec). Similarly from (3.36), Xa(jQ) ~ 0 for Q > 
2m (2000). Hence choosing 


1 


— = 25x 107° 
2 (2000) 7° * 10 


At=5x10° <« 


we can obtain za(m) and then implement (3.35) in MATLAB. 


% Analog Signal 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = exp(-1000*abs(t)) ; 
% Continuous-time Fourier Transform 

>>Wmax = 2*pi*2000; K = 500; k = 0:1:K; W = k*Wmax/K; 

>>Xa = xa * exp(-j*t’*W) * Dt; Xa = real(Xa); 

>>W = [-fliplr(W), W(2:501)]; % Omega from -Wmax to Wmax 
>>Xa = [fliplr(Xa), Xa(2:501)]; % Xa over -Wmax to Wmax interval 
>>subplot (2,1,1) ;plot(t*1000,xa) ; 

>>xlabel(’t in msec.’); ylabel(’xa(t)’) 

>>title(’ Analog Signal’) 

>>subplot (2,1,2) ;plot (W/(2*pix1000) ,Xa*1000) ; 
>>xlabel(’Frequency in KHz’); ylabel(’Xa(jW)*1000’ ) 
>>title(’Continuous-time Fourier Transform’) 


Figure 3.11 shows the plots of a(t) and Xa(jQ). Note that to reduce the number 
of computations, we computed Xa(jQ) over [0, 40007] rad/sec (or equivalently, 
over [0,2] KHz) and then duplicated it over [—40007, 0] for plotting purposes. 
The displayed plot of Xa(jQ) agrees with (3.36). 


EXAMPLE 3.19 To study the effect of sampling on the frequency-domain quantities, we will 
sample za(t) in Example 3.18 at 2 different sampling frequencies. 


a. Sample x,(t) at Fs = 5000 sam/sec to obtain x1(n). Determine and plot 


Xı (e7”). 
b. Sample xa(t) at Fs = 1000 sam/sec to obtain x2(n). Determine and plot 
Xale”). 
Solution a. Since the bandwidth of za(t) is 2KHz, the Nyquist rate is 4000 sam/sec, 
which is less than the given F’;. Therefore aliasing will be (almost) nonexis- 
tent. 
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FIGURE 3.11 Plots in Example 3.18 


MATLAB script: 


% Analog Signal 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = exp(-1000*abs(t)) ; 
% Discrete-time Signal 

>> Ts = 0.0002; n = -25:1:25; x = exp(-1000*abs(n*Ts) ) ; 

y/, Discrete-time Fourier transform 

>> K = 500; k = 0:1:K; w = pi*k/K; 

>> X = x * exp(-j*n’*w); X = real(X); 

>> w = [-fliplr(w), w(2:K+1)]; X = [fliplr(X), X(2:k+1)]; 
>> subplot (2,1,1);plot(t*1000,xa) ; 

>> xlabel(’t in msec.’); ylabel(’x1(n)’) 

>> title(’Discrete Signal’); hold on 

>> stem(n+Ts*1000,x); gtext(’Ts=0.2 msec’); hold off 

>> subplot (2,1,2);plot(w/pi,X); 

>> xlabel(’Frequency in pi units’); ylabel(’X1(w)’) 

>> title(’Discrete-time Fourier Transform’) 


In the top plot in Figure 3.12, we have superimposed the discrete signal x(n) 
over £a(t) to emphasize the sampling. The plot of X2(e”) shows that it is a 
scaled version (scaled by F, = 5000) of Xa (jQ). Clearly there is no aliasing. 
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FIGURE 3.12 Plots in Example 3.19a 


b. Here F, = 1000 < 4000. Hence there will be a considerable amount of alias- 
ing. This is evident from Figure 3.13, in which the shape of X (e?”) is different 
from that of Xa(jQ) and can be seen to be a result of adding overlapping 
replicas of Xa(jQ). 


3.4.3 RECONSTRUCTION 
From the sampling theorem and the preceding examples, it is clear that if 
we sample band-limited x,(t) above its Nyquist rate, then we can recon- 
struct £za(t) from its samples x(n). This reconstruction can be thought of 
as a 2-step process: 
e First the samples are converted into a weighted impulse train. 

XO a(n)d(t—nT,) = --+-+0(-1)6(n+T.) +2(0)6(t) + 2(1)6(n—Ts) +--- 


n=—Co 


e Then the impulse train is filtered through an ideal analog lowpass filter 
band-limited to the [—F/2, F;/2] band. 


Impulse train Ideal lowpass 
sD eas conversion | filter — salt) 
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FIGURE 3.13 Plots in Example 3.18b 


This two-step procedure can be described mathematically using an inter- 
polating formula [23] 


tq(t)= X` x(n)sinc[F,(t — nTs)] (3.37) 
where sinc(x) = *22# is an interpolating function. The physical inter- 


pretation of the above reconstruction (3.37) is given in Figure 3.14, from 
which we observe that this ideal interpolation is not practically feasible 
because the entire system is noncausal and hence not realizable. 


EXAMPLE 3.20 Consider the sampled signal x(n) from Example 3.17. It is applied as an in- 
put to an ideal D/A converter (that is, an ideal interpolator) to obtain the 
analog signal y.(t). The ideal D/A converter is also operating at Fs; = 200 
sam/sec. Obtain the reconstructed signal ya(t), and determine whether the sam- 
pling/reconstruction operation resulted in any aliasing. Also plot the Fourier 
transforms Xa (jQ), X (e°), and Ya(jQ). 
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Ts 
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+ Fe 
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l >t 
2T; 
| | | | y+ 
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Sampling Reconstruction 
FIGURE 3.14 Reconstruction of band-limited signal from its samples 
Solution We can determine ya(t) using (3.31). However, since all frequencies in the sinu- 


soidal sequence x(n) are between the primary period of -r < w < 7, we can 
equivalently obtain ya(t) by substituting n by tf. Thus from (3.31), we have 


Yalt) = a(n)| ir > 8) ee 


= 44 2cos (0.752008 + z) — 4sin(0.257200t) 


= 4+ 2cos (1507t T z) — 4sin(50rt) (3.38) 


As expected, the 175 Hz component in za(t) is aliased into the 25 Hz component 
in ya(t). 
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Using Euler’s identity on the given xa(t) and the properties, the CTFT 
Xa(jQ) is given by 


Xa(jQ) = 85(Q) + ret E(N — 150m) + 2reI7/76(Q + 1507) 


+ 4jr6(Q — 3507) — 4776(Q + 3507). (3.39) 
It is informative to plot the CTFT Xa(jQ) as a function of the cyclic frequency 
F in Hz using Q = 27r F. Thus the quantity X.(j27F) from (3.39) is given by 
Xq(j2nF) = 46(F) + e7 6(F — 75) + e 97/35(F +75) 
+2j6(F — 175) — 276(F + 175). (3.40) 
where we have used the identity 6(Q) = 6(27F) = =: 6(F). Similarly, the CTFT 
Ya(j27F) is given by 
Ya(j2nF) = 46(F) + e'"/36(F — 75) +e 9"/36(F + 75) 
+276(F — 25) — 276(F + 25). (3.41) 


Figure 3.15a shows the CTFT of the original signal x,(¢) as a function of 
F. The DTFT X(t”) of the sampled sequence x(n) is shown as a function of 
w in Figure 3.15b, in which the impulses due to shifted replicas are shown in 
gray shade for clarity. The ideal D/A converter response is also shown in gray 
shade. The CTFT of the reconstructed signal ya(t) is shown in Figure 3.15c 
which clearly shows the aliasing effect. 


Practical D/A converters In practice we need a different approach 
than (3.37). The two-step procedure is still feasible, but now we replace 
the ideal lowpass filter by a practical analog lowpass filter. Another in- 
terpretation of (3.37) is that it is an infinite-order interpolation. We want 
finite-order (and in fact low-order) interpolations. There are several ap- 
proaches to do this. 


e Zero-order-hold (ZOH) interpolation: In this interpolation a given 
sample value is held for the sample interval until the next sample is 
received. 


ĉalt) = x(n), nT; <n < (n+ 1)T, 


which can be obtained by filtering the impulse train through an inter- 
polating filter of the form 


0<t< T, 
ho(t) = f 
0, otherwise 
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FIGURE 3.15 Fourier transforms of the sinusoidal signals xa(t), x(n), and ya(t) 


which is a rectangular pulse. The resulting signal is a piecewise-constant 
(staircase) waveform which requires an appropriately designed analog 
postfilter for accurate waveform reconstruction. 


a(n) — | ZOH | — ĉa (t) — | Postfilter | — zalt) 


e 1st-order-hold (FOH) interpolation: In this case the adjacent sam- 
ples are joined by straight lines. This can be obtained by filtering the 
impulse train through 


0, otherwise 


Once again, an appropriately designed analog postfilter is required 
for accurate reconstruction. These interpolations can be extended 
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to higher orders. One particularly useful interpolation employed by 
MATLAB is the following. 

e Cubic spline interpolation: This approach uses spline interpolants 
for a smoother, but not necessarily more accurate, estimate of the ana- 
log signals between samples. Hence this interpolation does not require 
an analog postfilter. The smoother reconstruction is obtained by us- 
ing a set of piecewise continuous third-order polynomials called cubic 
splines, given by [3] 


aq (t) = a(n) + a(n) (t — nT.) + az(n) (t — nT)? 


+a3(n)(t—nT,)?, nTy<n<(n+1)T, (3.42) 


where {a;(n),0 < i < 3} are the polynomial coefficients, which are de- 
termined by using least-squares analysis on the sample values. (Strictly 
speaking, this is not a causal operation but is a convenient one in 
MATLAB.) 


3.4.4 MATLAB IMPLEMENTATION 

For interpolation between samples MATLAB provides several approaches. 
The function sinc(x), which generates the (sina) /mz function, can 
be used to implement (3.37), given a finite number of samples. If 
{a(n), nı <n < na} is given, and if we want to interpolate x, (t) on 
a very fine grid with the grid interval At, then from (3.37) 


Ta (mAt) = X` a(n)sinc [F.(mAt—nT.)], tı <mAt<tz (3.43) 


n=Nny1 


which can be implemented as a matrix-vector multiplication operation as 
shown below. 


>> n = ni:n2; t = t1:t2; Fs = 1/Ts; nTs = n*Ts; % Ts is the sampling interval 
>> xa = x * sinc(Fs*(ones(length(n) ,1)*t-nTs’*ones(1,length(t)))); 


Note that it is not possible to obtain an exact analog x(t) in light of the 
fact that we have assumed a finite number of samples. We now demon- 
strate the use of the sinc function in the following two examples and also 
study the aliasing problem in the time domain. 


EXAMPLE 3.21 From the samples x(n) in Example 3.19a, reconstruct a(t) and comment on 
the results. 


Solution Note that x1(n) was obtained by sampling xa(t) at Ts = 1/F's = 0.0002 sec. We 
will use the grid spacing of 0.00005 sec over —0.005 < t < 0.005, which gives 
x(n) over —25 < n < 25. 
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Reconstructed Signal from x1(n) using sinc function 
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FIGURE 3.16 Reconstructed signal in Example 3.21 


MATLAB script: 


% Discrete-time Signal x1(n) 
>> Ts = 0.0002; n = -25:1:25; nTs = n*Ts; x = exp(-1000*abs(nTs)); 
% Analog Signal reconstruction 
>> Dt = 0.00005; t = -0.005:Dt:0.005; 
>> xa = x * sinc(Fs*(ones(length(n) ,1)*t-nTs’*ones(1,length(t)))); 
i, check 
>> error = max(abs(xa - exp(-1000*abs(t)))) 
error = 
0.0363 


The maximum error between the reconstructed and the actual analog signal is 
0.0363, which is due to the fact that x(t) is not strictly band-limited (and also 
we have a finite number of samples). From Figure 3.16, we note that visually 
the reconstruction is excellent. 


EXAMPLE 3.22 From the samples x2(n) in Example 3.17b reconstruct xa(t) and comment on 
the results. 


Solution In this case 72(n) was obtained by sampling q(t) at Ts = 1/F; = 0.001 sec. We 
will again use the grid spacing of 0.00005 sec over —0.005 < t < 0.005, which 
gives x(n) over —5 <n < 5. 


% Discrete-time Signal x2(n) 
>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; x = exp(-1000*abs(nTs)); 
% Analog Signal reconstruction 
>> Dt = 0.00005; t = -0.005:Dt:0.005; 
>> xa = x * sinc(Fs*(ones(length(n) ,1)*t-nTs’*ones(1,length(t)))); 
% check 
>> error = max(abs(xa - exp(-1000*abs(t)))) 
error = 
0.1852 
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Reconstructed Signal from x2(n) Using Sinc Function 
1 T T T f T T 
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FIGURE 3.17 Reconstructed signal in Example 3.22 


The maximum error between the reconstructed and the actual analog signals is 
0.1852, which is significant and cannot be attributed to the nonband-limitedness 
of xa(t) alone. From Figure 3.17, observe that the reconstructed signal differs 
from the actual one in many places over the interpolated regions. This is the 
visual demonstration of aliasing in the time domain. 


The second MATLAB approach for signal reconstruction is a plotting 
approach. The stairs function plots a staircase (ZOH) rendition of the 
analog signal, given its samples, while the plot function depicts a linear 
(FOH) interpolation between samples. 


EXAMPLE 3.23 Plot the reconstructed signal from the samples xı (n) in Example 3.19 using the 
ZOH and the FOH interpolations. Comment on the plots. 


Solution Note that in this reconstruction we do not compute xq(t) but merely plot it 
using its samples. 


0.0002 
n*Ts; x = exp(-1000*abs(nTs)) ; 


% Discrete-time Signal x1(n) : Ts 
>> Ts = 0.0002; n = -25:1:25; nTs 
% Plots 

>> subplot(2,1,1); stairs (nTs*1000,x) ; 

>> xlabel(’t in msec.’); ylabel(’xa(t)’) 

>> title(’Reconstructed Signal from x1(n) using zero-order-hold’); hold on 
>> stem(n*Ts*1000,x); hold off 

h 

% Discrete-time Signal x2(n) : Ts = 0.001 

>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; x = exp(-1000*abs(nTs)); 

% Plots 

>> subplot(2,1,2); plot(nTs*1000,x); 

>> xlabel(’t in msec.’); ylabel(’xa(t)’) 

>> title(’Reconstructed Signal from x2(n) using zero-order-hold’); hold on 
>> stem(n*Ts*1000,x); hold off 
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Reconstructed Signal from x1(n) using zero—order—hold 
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FIGURE 3.18 Signal reconstruction in Example 3.23 


The plots are shown in Figure 3.18, from which we observe that the ZOH re- 
construction is a crude one and that the further processing of analog signal is 
necessary. The FOH reconstruction appears to be a good one, but a careful 
observation near t = 0 reveals that the peak of the signal is not correctly repro- 
duced. In general, if the sampling frequency is much higher than the Nyquist 
rate, then the FOH interpolation provides an acceptable reconstruction. 


The third approach of reconstruction in MATLAB involves the use 
of cubic spline functions. The spline function implements interpolation 
between sample points. It is invoked by xa = spline(nTs,x,t), in which 
x and nTs are arrays containing samples x(n) at nT, instances, respec- 
tively, and t array contains a fine grid at which x,(t) values are desired. 
Note once again that it is not possible to obtain an exact analog x(t). 


EXAMPLE 3.24 From the samples zı (n) and x2(n) in Example 3.19, reconstruct x(t) using the 
spline function. Comment on the results. 


Solution This example is similar to Examples 3.21 and 3.22. Hence sampling parameters 
are the same as before. 
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Reconstructed Signal from x1(n) using cubic spline function 
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FIGURE 3.19 Reconstructed signal in Example 3.24 


MATLAB script: 


% a) Discrete-time Signal x1(n): Ts = 0.0002 

>> Ts = 0.0002; n = -25:1:25; nTs = n*Ts; x = exp(-1000*abs(nTs) ) ; 
% Analog Signal reconstruction 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = spline(nTs,x,t); 

%, check 

>> error = max(abs(xa - exp(-1000*abs(t)))) 

error = 0.0317 


The maximum error between the reconstructed and the actual analog signal is 
0.0317, which is due to the nonideal interpolation and the fact that xa(t) is 
nonband-limited. Comparing this error with that from the sinc (or ideal) inter- 
polation, we note that this error is lower. The ideal interpolation generally suf- 
fers more from time-limitedness (or from a finite number of samples). From the 
top plot in Figure 3.19 we observe that visually the reconstruction is excellent. 


MATLAB script: 


% Discrete-time Signal x2(n): Ts = 0.001 
>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; x 
% Analog Signal reconstruction 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = spline(nTs,x,t); 


exp(-1000*abs(nTs)) ; 
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% check 
>> error = max(abs(xa - exp(-1000*abs(t)))) 
error = 0.1679 


The maximum error in this case is 0.1679, which is significant and cannot be 
attributed to the nonideal interpolation or nonband-limitedness of xa(t). From 
the bottom plot in Figure 3.19 observe that the reconstructed signal again 
differs from the actual one in many places over the interpolated regions. 


From these examples it is clear that for practical purposes the spline 
interpolation provides the best results. 


3.5 PROBLEMS 
———————————_—_— 


P3.1 Using the matrix-vector multiplication approach discussed in this chapter, write a 
MATLAB function to compute the DTFT of a finite-duration sequence. The format of 
the function should be 


function [X] = dtft(x,n,w) 
% Computes Discrete-time Fourier Transform 


%, (X] = dtft(x,n,w) 

% X = DTFT values computed at w frequencies 
% x = finite duration sequence over n 

% n = sample position vector 

% w = frequency location vector 


Use this function to compute the DTFT X(e?”) of the following finite-duration sequences 
over —7 < w < m. Plot DTFT magnitude and angle graphs in one figure window. 


= {4,3,2,1,1,2,3,4}. Comment on the angle plot. 


; 
{4, 3, 2,1, —1, —2, —3, —4}. Comment on the angle plot. 
; 


P3.2 Let xı(n) = {1,2,2,1}. A new sequence x2(n) is formed using 
T 


xi(n), O<n<3; 
ao(n)=< zı(n— 4), 4<n<7; (3.44) 
0, Otherwise. 


1. Express X2(e’”) in terms of Xi(e?”) without explicitly computing Xi (e7”). 
2. Verify your result using MATLAB by computing and plotting magnitudes of the 
respective DTFTs. 
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P3.3 Determine analytically the DTFT of each of the following sequences. Plot the magnitude 
and angle of X(e’“) over 0< w <7. 

a(n) = 2 (0.5)” u(n + 2). 

a(n) = (0.6)!"! [u(n + 10) — u(n — 11)). 

x(n) = n (0.9)” u(n + 3). 

a(n) = (n + 3) (0.8)°7} u(n — 2). 

x(n) = 4 (—0.7)” cos(0.257n)u(n). 


ae 


P3.4 The following finite-duration sequences are called windows and are very useful in DSP. 


10<n<M. 


Rectangular: Rm(n) = Pee age 


Hanning: Cm (n) = 0.5 E cos Kaa | Ruin ) 
Triangular: Zm (n) = h uM a Ru(n); 


Hamming: Has(n) = [0.54 — 0.46 cos rl Rau(n) 

For each of these windows, determine their DTFTs for M = 10, 25, 50, 101. Scale 
transform values so that the maximum value is equal to 1. Plot the magnitude of the 
normalized DTFT over —r < w < r. Study these plots and comment on their behavior as 
a function of M. 


P3.5 Using the definition of the DTFT in (3.1), determine the sequences corresponding to the 
folowing DTFTs: 


1. X(e’”) = 3 +2cos(w) + 4cos(2w). 

2. X(e?”) = [1 — 6 cos(3w) + 8 cos(5w)] e773. 

3. X(e!”) = 24 j4sin(2w) — 5cos(4w). 

4. X(e)”) = [1 + 2cos(w) + 3 cos(2w)] cos(w/2)e"7>"/?. 
5. X(e?”) = j [3 + 2cos(w) + 4 cos(2w)] sin(w)e~ 7”. 


P3.6 Using the definition of the inverse DTFT in (3.2), determine the sequences corresponding 
to the following DTFTs: 


; 1, 0< |w| < 7/3; 
jw) ’ = 3 , 
lele ei T/3 < |w| <r. 


; 0, 0< |w| < 37/4; 
jw\ __ ’ = = , 
BENE att 37/4 < |w| <r. 


2, O<|w| < 7/8; 
3. X(e’") =< 1, 1/8 < |w| < 30/4. 


0, =r < |w| < 1/4; 
4. X(e”)= 4 1, 1/4 < |w| < 37/4. 

0, 37/4 < |wl <r. 
5. X(e") Swe 72), 
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Remember that the above transforms are periodic in w with period equal to 27. Hence, 
functions are given only over the primary period of =r < w < T. 


P3.7 A complex-valued sequence x(n) can be decomposed into a conjugate symmetric part 
ze(n) and an conjugate anti-symmetric part x(n) as discussed in Chapter 2. Show that 


F [xe(n)] = Xpr(e!”) and F [x.(n)] = jX”) 


where Xr(e!”) and Xr(e”) are the real and imaginary parts of the DTFT X(e?”) 
respectively. Verify this property on 


x(n) = 2(0.9)~” [cos(0.1an) + j sin(0.97n)] [u(n) — u(n — 10)] 
using the MATLAB functions developed in Chapter 2. 


P3.8 A complex-valued DTFT X(e”) can also be decomposed into its conjugate symmetric 
part X-(e?”) and conjugate anti-symmetric part X.(e’”), i.e., 


X(e*) = X.(e) + Xo(e) 
where 


Xe(e™) = ZIX (P) + Xe) and Xole”) = 5 [X(e%) X (e) 


NI = 


Show that 
F[X.(e*)]| =an(n) and FXole)] = jar(n) 
where xr(n) and zz(n) are the real and imaginary parts of x(n). Verify this property on 
x(n) = 7" [u(n) — u (n — 20) 
using the MATLAB functions developed in Chapter 2. 


P3.9 Using the frequency-shifting property of the DTFT, show that the real part of X (e3”) of 
a sinusoidal pulse 


x(n) = (coswon)Rm (n) 
where Razs(n) is the rectangular pulse given in Problem P3.4 is given by 


Xa(e”) = poft —wo)(M — 2) sin {(w — wo) M/2} 


2 sin { (w — wo) /2} 
1 be. { (w+ wo)(M — 2) sin {|w — (27 — wo)] M/2} 
"2 2 sin {[w — (2r — wo)] /2} 


Compute and plot Xp(e’”) for wo = 7/2 and M = 5, 15, 25, 100. Use the plotting 
interval [—7, 7]. Comment on your results. 


P3.10 Let x(n) = Tio(n) be a triangular pulse given in Problem P3.4. Using properties of the 
DTFT, determine and plot the DTFT of the following sequences. 


1. a(n) = Tio(—n) 

2. a(n) = Tio(n) — Tio(n — 10) 
3. x(n) = Tio(n) * Tio(—n) 

4. x(n) = Tio(n)e3”” 

5. x(n) = cos(0.1rn)Tio(n) 
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P3.11 For each of the linear, shift-invariant systems described by the impulse response, 
determine the frequency response function H(e’“). Plot the magnitude response |H(e’”)| 
and the phase response /H(e)”) over the interval [—7, 7]. 


h(n) = (0.9)!"! 

h(n) = sinc(0.2n)[u(n + 20) — u(n — 20)], where sinc 0 = 1. 
h(n) = sinc(0.2n)[u(n) — u(n — 40)] 

h(n) = [(0.5)” + (0.4)”Ju(n) 

h(n) = (0.5)!! cos(0.1mn) 


OY. ee Oe: Ne 


P3.12 Let x(n) = Acos(won + ĝo) be an input sequence to an LTI system described by the 
impulse response h(n). Show that the output sequence y(n) is given by 


y(n) = A|H(e?”°)| cos[won + 00 + ZH(e*”°)| 


P3.13 Let x(n) = 3cos (0.57 + 60°) + 2sin (0.37) be the input to each of the systems 
described in Problem P3.11. In each case, determine the output sequence y(n). 


P3.14 An ideal lowpass filter is described in the frequency domain by 


I meds |u| < We 


JW) 
Hale ={ 0, we < |u| <a 


where we is called the cutoff frequency and a is called the phase delay. 


1. Determine the ideal impulse response ha(n) using the IDTFT relation (3.2). 
2. Determine and plot the truncated impulse response 


niny = { i O0<n<N-1 


0, otherwise 


for N = 41, a = 20, and we = 0.57. 
3. Determine and plot the frequency response function H(e?“), and compare it with the 
ideal lowpass filter response Hg(e’“). Comment on your observations. 


P3.15 An ideal highpass filter is described in the frequency-domain by 


j 1-69, we < |u| <a 
DOIN a , c = 
Ha(e"™) = { 0, |w| < we 


where we is called the cutoff frequency and a is called the phase delay. 


1. Determine the ideal impulse response ha(n) using the IDTFT relation (3.2). 
2. Determine and plot the truncated impulse response 


_ Shan), O<n<N-1 
og { 0, otherwise 


for N = 31, a= 15, and we = 0.57. 
3. Determine and plot the frequency response function H(e”), and compare it with the 
ideal highpass filter response Hy(e’”). Comment on your observations 
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P3.16 For a linear, shift-invariant system described by the difference equation 


y(n) = 5 bma (n — m) -X ay (n-2 
m=0 f=1 


the frequency-response function is given by 


M b e7ie™m 


H jw __ Dae m: 
(e) a 
1+ er, age~ I 


Write a MATLAB function freqresp to implement this relation. The format of this 
function should be 


function [H] = freqresp(b,a,w) 

% Frequency response function from difference equation 

% [H] = freqresp(b,a,w) 

= frequency response array evaluated at w frequencies 
numerator coefficient array 

denominator coefficient array (a(1)=1) 

frequency location array 


x 
goo m 
Il 


P3.17 Determine H(ef®), and plot its magnitude and phase for each of the following systems: 


1. y(n) = 2 wees x(n —m) 
2. y(n) = x(n) — a(n — 2) + 0.95y(n — 1) — 0.9025y(n — 2) 
3. y(n) = x(n) — a(n — 1) + a(n — 2) + 0.95y(n — 1) — 0.9025y(n — 2) 
4. y(n) = x(n) — 1.76782(n — 1) + 1.56252(n — 2) + 1.1314y(n — 1) — 0.64y(n — 2) 
5. y(n) = z(n) — X; (0.5) y(n — £) 
P3.18 A linear, shift-invariant system is described by the difference equation 


3 3 
y(n) = X` z (n — 2m) — X` (0.81) y(n — 20) 


m=0 £=1 


Determine the steady-state response of the system to the following inputs: 
1. a(n) =5+10(-1)” 

2. x(n) = 1 + cos (0.570 + 7/2) 

3. x(n) = 2sin (mn/4) + 3cos (38an/4) 

4. x(n) = $} (k + 1) cos (wkn/4) 

5. x(n) = cos (mn) 


In each case, generate x(n), 0 < n < 200, and process it through the filter function to 
obtain y(n). Compare your y(n) with the steady-state responses in each case. 


P3.19 An analog signal za (t) = sin (10007t) is sampled using the following sampling intervals. 
In each case, plot the spectrum of the resulting discrete-time signal. 
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1. Ts = 0.1 ms 
2. T; =1ms 
3. T; = 0.01 sec 


P3.20 We implement the following analog filter using a discrete filter. 


za (t) — | A/D] 2 [a(n) | “2 [D/A] — ya (t) 


The sampling rate in the A/D and D/A is 8000 sam/sec, and the impulse response is 
h(n) = (—0.9)” u(n). 


1. What is the digital frequency in x(n) if £a (t) = 10 cos (10, 0007t)? 

Determine the steady-state output Ya (t) if £a (t) = 10 cos (10, 000zt). 

Determine the steady-state output Ya (t) if £a (t) = 5sin(8, 000zt). 

Find two other analog signals x, (t), with different analog frequencies, that will give 

the same steady-state output ya(t) when a(t) = 10 cos(10,000zt) is applied. 

5. To prevent aliasing, a prefilter would be required to process £a (t) before it passes to 
the A/D converter. What type of filter should be used, and what should be the largest 
cutoff frequency that would work for the given configuration? 


02S 


P3.21 Consider an analog signal xa (t) = cos(20mt), O < t < 1. It is sampled at Ts = 0.01, 0.05, 
and 0.1 sec intervals to obtain x(n). 


1. For each T, plot x(n). 

2. Reconstruct the analog signal ya (t) from the samples x(n) using the sinc interpolation 
(use At = 0.001) and determine the frequency in ya (t) from your plot. (Ignore the end 
effects.) 

3. Reconstruct the analog signal ya (t) from the samples x(n) using the cubic spline 
interpolation, and determine the frequency in ya (t) from your plot. (Again, ignore the 
end effects.) 

4. Comment on your results. 


P3.22 Consider the analog signal £a (t) = cos (20mt + 0), 0 < t < 1. It is sampled at Ts = 0.05 
sec intervals to obtain x(n). Let 6 = 0, 7/6, 7/4, 7/3, 1/2. For each of these @ values, 
perform the following. 


1. Plot za (t) and superimpose x(n) on it using the plot(n,x,’o’) function. 

2. Reconstruct the analog signal ya (t) from the samples x(n) using the sinc interpolation 
(Use At = 0.001) and superimpose x(n) on it. 

3. Reconstruct the analog signal ya (t) from the samples x(n) using the cubic spline 
interpolation and superimpose x(n) on it. 

4. You should observe that the resultant reconstruction in each case has the correct 
frequency but a different amplitude. Explain this observation. Comment on the role of 
phase of £a (t) on the sampling and reconstruction of signals. 
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CHAPTER 


The zTransform 


In Chapter 3 we studied the discrete-time Fourier transform approach for 
representing discrete signals using complex exponential sequences. This 
representation clearly has advantages for LTI systems because it describes 
systems in the frequency domain using the frequency response function 
H(e3”). The computation of the sinusoidal steady-state response is greatly 
facilitated by the use of H(e?”). Furthermore, response to any arbitrary 
absolutely summable sequence x(n) can easily be computed in the fre- 
quency domain by multiplying the transform X(e’”) and the frequency 
response H(e!”). However, there are two shortcomings to the Fourier 
transform approach. First, there are many useful signals in practice— 
such as u(n) and nu(n)—for which the discrete-time Fourier transform 
does not exist. Second, the transient response of a system due to ini- 
tial conditions or due to changing inputs cannot be computed using the 
discrete-time Fourier transform approach. 

Therefore we now consider an extension of the discrete-time Fourier 
transform to address these two problems. This extension is called the 
z-transform. Its bilateral (or two-sided) version provides another domain 
in which a larger class of sequences and systems can be analyzed, and its 
unilateral (or one-sided) version can be used to obtain system responses 
with initial conditions or changing inputs. 


4.1 THE BILATERAL z-TRANSFORM 
—— g 


The z-transform of a sequence x(n) is given by 
Co 


X(2) Ê Z[e(n)]) = X a(n)” (4.1) 


103 
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where z is a complex variable. The set of z values for which X(z) exists 
is called the region of convergence (ROC) and is given by 


Rz- < |z| < Re+ (4.2) 


for some non-negative numbers R,— and Rz+. 
The inverse z-transform of a complex function X (z) is given by 


Z7"|X(z)] : f Xe "ae (4.3) 


where C is a counterclockwise contour encircling the origin and lying 
in the ROC. 


Comments: 


1. The complex variable z is called the complex frequency given by z = 
|z|e?”, where |z| is the magnitude and w is the real frequency. 

2. Since the ROC (4.2) is defined in terms of the magnitude |z|, the shape 
of the ROC is an open ring, as shown in Figure 4.1. Note that Rz- 
may be equal to zero and/or Ry, could possibly be oo. 

3. If Re+ < Ry_, then the ROC is a null space and the z-transform does 
not exist. 

4. The function |z| = 1 (or z = e?”) is a circle of unit radius in the z-plane 
and is called the unit circle. If the ROC contains the unit circle, then 
we can evaluate X(z) on the unit circle. 


Co 


X(2)lenee = X(t) = $ a(n) = Fla(n)] 


n=—Co 


Therefore the discrete-time Fourier transform X(e7”) may be viewed 
as a special case of the z-transform X (z). 


Im{z} 


FIGURE 4.1 A general region of convergence 
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Re{z} 


FIGURE 4.2 The ROC in Example 4.1 


EXAMPLE 4.1 Let xı(n) = a”u(n), 0 < |a| < oo. (This sequence is called a positive-time 
sequence). Then 


= Hie = a\” 1 la 
Xi(z) = > a” z > (2) iori if 7 <1 
= , |z|> al => ROG: |al < |z| < c0 
z—a sow ~ 


Ric Re+ 
Note: Xı(z) in this example is a rational function; that is, 


A B(z) z 


A(z) z-a 
where B(z) = z is the numerator polynomialand A(z) = z—a is the denominator 
polynomial. The roots of B(z) are called the zeros of X(z), whereas the roots 
of A(z) are called the poles of X(z). In this example X1(z) has a zero at the 
origin z = 0 and a pole at z = a. Hence x1(n) can also be represented by a 
pole-zero diagram in the z-plane in which zeros are denoted by o and poles by 
x as shown in Figure 4.2. 


X1(z) 


EXAMPLE 4.2 Let x2(n) = —b”u(—n—1),0 < |b| < oo. (This sequence is called a negative-time 
sequence.) Then 


1 _ 2 
l-2z/b  z-b’ 


ROC2: _ 0 >< |z| < |) 
“~~ sow 


Ry Rot 


The ROC2 and the pole-zero plot for this x2(n) are shown in Figure 4.3. 


Im{z} 


Re{z} 
Xb 


FIGURE 4.3 The ROC in Example 4.2 
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Note: Ifb = a in this example, then X2(z) = X1(z) except for their respective 
ROCs; that is, ROC; 4 ROC2. This implies that the ROC is a distinguishing 
feature that guarantees the uniqueness of the z-transform. Hence it plays a very 
important role in system analysis. 


EXAMPLE 4.3 Let x3(n) = x1(n) + z2(n) = a” u(n) — b"”u(—n — 1) (This sequence is called a 
two-sided sequence.) Then using the preceding two examples, 


Co 


-1 
X3(z) = Scare — Se aa 


n=0 


={ Ž ROC: jel > lal} + {= ROCs: lel < lèl} 


z-a’ 
— Z z . 
= aa =o 
If |b| < |a|, than ROC; is a null space, and X3(z) does not exist. If |a| < |b], 
then the ROC; is |a| < |z| < |b|, and X3(z) exists in this region as shown in 
Figure 4.4. 


ROC3: ROC1 N ROC2 


4.1.1 PROPERTIES OF THE ROC 
From the observation of the ROCs in the preceding three examples, we 
state the following properties. 


1. The ROC is always bounded by a circle since the convergence 
condition is on the magnitude |z]. 

2. The sequence x1(n) = a”u(n) in Example 4.1 is a special case of a right- 
sided sequence, defined as a sequence x(n) that is zero for some n < 
no. From Example 4.1, the ROC for right-sided sequences is always 
outside of a circle of radius R,_. If no > 0, then the right-sided 
sequence is also called a causal sequence. 

3. The sequence x(n) = —b”u(—n—1) in Example 4.2 is a special case of a 
left-sided sequence, defined as a sequence x(n) that is zero for some n > 
no. If no < 0, the resulting sequence is called an anticausal sequence. 
From Example 4.2, the ROC for left-sided sequences is always inside 
of a circle of radius Rz+. 


Im{z} Im{z} 
a 
x 
xa 
Re{z} Re{z} 
0 £ 0 
bx 
a>b a<b 


FIGURE 4.4 The ROC in Example 4.3 
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4. The sequence x3(n) in Example 4.3 is a two-sided sequence. The ROC 
for two-sided sequences is always an open ring Re- < |z| < Re+, 
if it exists. 

5. The sequences that are zero for n < nı and n > nz are called 
finite-duration sequences. The ROC for such sequences is the entire 
z-plane. If nı < 0, then z = œ is not in the ROC. If ng > 0, then 
z = 0 is not in the ROC. 

6. The ROC cannot include a pole since X(z) converges uniformly in 
there. 

7. There is at least one pole on the boundary of a ROC of a rational X(z). 

8. The ROC is one contiguous region; that is, the ROC does not come in 
pieces. 


In digital signal processing, signals are assumed to be causal since 
almost every digital data is acquired in real time. Therefore the only 
ROC of interest to us is the one given in statement 2. 


4.2 IMPORTANT PROPERTIES OF THE z-TRANSFORM 
ae 


The properties of the z-transform are generalizations of the properties 
of the discrete-time Fourier transform that we studied in Chapter 3. We 
state the following important properties of the z-transform without proof. 


1. Linearity: 


Z [aizi (n) + a2%2(n)] = a1 Xı (2) + agXo(z); ROC: ROC,, N ROC,, 


(4.4) 
2. Sample shifting: 
Z |z (n — no) =z "X(z); ROC: ROC, (4.5) 
3. Frequency shifting: 
Z |a"z(n)] = X () ; ROC: ROC, scaled by |a| (4.6) 
4. Folding: 
Z |a(—n)| = X (1/z); ROC: Inverted ROC, (4.7) 
5. Complex conjugation: 
Z |a*(n)] = X*(z*); ROC: ROC, (4.8) 
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6. Differentiation in the z-domain: 


dX 
Z [ne(n)] = — ROC: ROC, (4.9) 
This property is also called the multiplication-by-a-ramp property. 
7. Multiplication: 


1 
Z [ea(n}ea(n)] = 5 $ X0x (ehv) van; (4.10) 
C 
ROC: ROC,;, N Inverted ROC+z, 


where C is a closed contour that encloses the origin and lies in the 
common ROC. 
8. Convolution: 


Z [a1 (n) * xa(n)] = Xı(2)X2(2); ROC: ROC}, N ROC,, (4.11) 


This last property transforms the time-domain convolution operation 
into a multiplication between two functions. It is a significant property 
in many ways. First, if X,(z) and Xə(z) are two polynomials, then their 
product can be implemented using the conv function in MATLAB. 


EXAMPLE 4.4 Let Xi(z) = 2 +327" +427? and Xo(z) = 3 + 427' +527? + 627°. Determine 
X3(z) = Xı (2)X2(2). 


Solution From the definition of the z-transform, we observe that 


xi(n) = {2,3,4} and xo(n) = {3,4,5,6} 
T T 


Then the convolution of these two sequences will give the coefficients of the 
required polynomial product. 


MATLAB script: 


>> x1 = [2,3,4]; x2 = [3,4,5,6]; x3 = conv(xi,x2) 
x3 = 6 17 34 43 38 24 


Hence 


X3(z) = 6 +1727} +3427? +4327? + 38274 + 2427 


Using the conv_m function developed in Chapter 2, we can also multiply 
two z-domain polynomials corresponding to noncausal sequences. 


EXAMPLE 4.5 Let Xi(z) = z+24+327' and Xo(z) = 227 +42+3+45271. Determine X3(z) = 
X1(z)X2(z). 
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Solution Note that 
xi(n) = {1,2,3} and xo(n) = {2,4, 3, 5} 
T 


Using the MATLAB script, 


SS oscil S ES aml S e a 29 S [D4 sills w2 S ely 
>> [x3,n3] = conv_m(x1i,n1,x2,n2) 


x3 = 
2 8 17 23 19 15 

n3 = 
=E) z2 zi 0 1 2 

we have 


X3(z) = 22? +82? +172 + 23 + 19271 4 1527? 


In passing we note that to divide one polynomial by another one, we 
would require an inverse operation called deconvolution [23, Chapter 6]. 
In MATLAB [p,r] = deconv(b,a) computes the result of dividing b by 
a in a polynomial part p and a remainder r. For example, if we divide the 
polynomial X3(z) in Example 4.4 by Xı (z), as follows, 


>> x3 = [6,17,34,43,38,24]; x1 = [2,3,4]; [x2,r] = deconv(x3,x1) 
x2 = 


then we obtain the coefficients of the polynomial X2(z) as expected. To 
obtain the sample index, we will have to modify the deconv function as 
we did in the conv_m function. This is explored in Problem P4.10. This 
operation is useful in obtaining a proper rational part from an improper 
rational function. 

The second important use of the convolution property is in system 
output computations as we shall see in a later section. This interpretation 
is particularly useful for verifying the z-transform expression X(z) of a 
casual sequence using MATLAB. Note that since MATLAB is a numerical 
processor (unless the Symbolic toolbox is used), it cannot be used for 
symbolic z-transform calculations. We will now elaborate on this. Let 
x(n) be a sequence with a rational transform 


where B(z) and A(z) are polynomials in 271. If we use the coefficients of 
B(z) and A(z) as the b and a arrays in the filter routine and excite this 
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Solution 
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EXAMPLE 4.6 


filter by the impulse sequence (n), then from (4.11) and using Z[6(n)] = 
1, the output of the filter will be x(n). (This is a numerical approach 
of computing the inverse z-transform; we will discuss the analytical ap- 
proach in the next section.) We can compare this output with the given 
x(n) to verify that X(z) is indeed the transform of x(n). This is illus- 
trated in Example 4.6. An equivalent approach is to use the impz function 


Chapter 4 m@ THE zTRANSFORM 


discussed in Chapter 2. 


4.2.1 SOME COMMON zTRANSFORM PAIRS 

Using the definition of z-transform and its properties, one can determine 
z-transforms of common sequences. A list of some of these sequences is 
given in Table 4.1. 


TABLE 4.1 Some common z-transform pairs 


Sequence 


—b"u(—n — 1) 


[a” sin won] u(n) 


la” cos won] u(n) 


na”™u(n) 


—nb"u(—n — 1) 


Using z-transform properties and the z-transform table, determine the z- 


transform of 


Transform 
1 
1 
1—2z-1 
1 
1— z7! 

1 
1—az-! 
1 
1—bz-1 


(asin wo)z~* 


1 — (2acoswo)z-! + a?z7? 


1 — (a cos wọo)z ~ 


1 — (2acoswo)z-! + a?z7? 


az! 


(1 — az-1)? 
bz! 
(1 — bz-1)2 


ROC 


(n — 2)(0.5)~®) cos Eg — 2)| u(n — 2) 


Applying the sample-shift property, 


X(z) 


Zje(n)] = z? Z [n(0.5)" cos (=) u(n)| 
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with no change in the ROC. Applying the multiplication by a ramp property, 


igr { GZ 00.5)" cos($n)u(n)] \ 


dz 


with no change in the ROC. Now the z-transform of (0.5)” cos($n)u(n) from 
Table 4.1 is 


Tn 1 — (0.5 cos Z)z7t 
z |(0.5)” cos ( Z2 = 3 ; ; 
[o 5) cos ( 3 ) u(n)| 1 — 2(0.5 cos 4)z | + 0.257? |z| > 0.5 


1— 0.25271 


a * E 
osio 7l >05 
Hence 
d 1 — 0.2527! 
X Si 0.5 
me { 1052-7 + a} ies 
a —0.25277 + 0.527% — 0.0625274 Jews 
1— 2-1 + 0.75272 — 0.25273 + 0.06252-4 [ ’ ; 
-3 _ Q 57-4 -5 

0.252 0.5z ~*~ + 0.0625z z >05 


~ T— 2-1 +0.752-2 — 0.2573 + 0.062574 


MATLAB verification: To check that this X(z) is indeed the correct expression, 
let us compute the first 8 samples of the sequence x(n) corresponding to X(z), 
as discussed before. 


>> b = [0,0,0,0.25,-0.5,0.0625]; a = [1,-1,0.75,-0.25,0.0625] ; 
>> [delta,n]=impseq(0,0,7) 


delta = 
1 0 0 0 0) 0 (0) 0 
n= 
0 1 2 3 4 5 6 y 
>> x = filter(b,a,delta) % check sequence 
x = 
Columns 1 through 4 


0 (0) O 0.25000000000000 
Columns 5 through 8 
-0.25000000000000 -0.37500000000000 -0.12500000000000 0.07812500000000 
>> x = [(n-2).*(1/2) .^(n-2) .*cos (pix (n-2)/3)].*stepseq(2,0,7) % original sequence 
x= 
Columns 1 through 4 
0 0 O 0.25000000000000 
Columns 5 through 8 
-0.25000000000000 -0.37500000000000 -0.12500000000000 0.07812500000000 


This approach can be used to verify the z-transform computations. 
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4.3 INVERSION OF THE z-TRANSFORM 
a 


From equation (4.3), the inverse z-transform computation requires an 
evaluation of a complex contour integral that, in general, is a complicated 
procedure. The most practical approach is to use the partial fraction ex- 
pansion method. It makes use of the z-transform Table 4.1 (or similar 
tables available in many textbooks). The z-transform, however, must be 
a rational function. This requirement is generally satisfied in digital signal 
processing. 


Central Idea 


e When X(z) is a rational function of z~!, it can be expressed as a sum 
of simple factors using the partial fraction expansion. The individual 
sequences corresponding to these factors can then be written down 
using the z-transform table. 

The inverse z-transform procedure can be summarized as follows: 


Method 
e Given 
bo +b274 bmz M 
A Re- Ry 4.12 
(z) Ltazyz-t+-+-+anz-% ’ Lebe 4 ( ) 
e express it as 
b b Fl sae b = —(N-1) M-N 
X(z) = o + 012 + + ON-1Z : D E 
1+aiz™ l+: +ayz 7N 2 


— 
polynomial part if M>N 


Proper rational part 
where the first term on the right-hand side is the proper rational part, 
and the second term is the polynomial (finite-length) part. This can 
be obtained by performing polynomial division if M > N using the 
deconv function. 

e Perform a partial fraction expansion on the proper rational part of 
X (z) to obtain 


N R M-N 
k = 
KG) Vice at Ce (4.13) 
k=1 k=0 
M>N 
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where pp is the kth pole of X(z) and R, is the residue at pp. It is 
assumed that the poles are distinct for which the residues are given by 


E bo + bizm! +-+ by ATD 
E 1+aiz™!t +- + anz N 


Rk (1 — pp27') 


2=Pk 


For repeated poles the expansion (4.13) has a more general form. If a 
pole pz has multiplicity r, then its expansion is given by 


3 Rp z7) Re Rk 227! ; Rue} 
 (L—ppz-t)’ pee) (1 — pet)? (1 — p271)" 
(4.14) 


where the residues Ry,¢ are computed using a more general formula, 
which is available in reference [23]. 
e assuming distinct poles as in (4.13), write x(n) as 


N 1 M-N 
k=1 k=0 
M>N 


e finally, use the relation from Table 4.1 


ae ee als 
—phu(—n-1) || > Res 


to complete x(n). 


A similar procedure is used for repeated poles. 


EXAMPLE 4.7 Find the inverse z-transform of «(z) = ee ee 
322 —4z41 
Solution Write 
1,-1 
2 =z 
X(z) = = 3 
@) 3(z2 — $z + 4) 1— 2-14 $272 
eens 1 1 
_ 3% __ 2 2 
(l—2-1)- $271) 1-2! 1- $271 
or 


e 


Now, X (z) has two poles: z1 = 1 and z2 = 3 and since the ROC is not specified, 
there are three possible ROCs as shown in Figure 4.5. 
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Im{z} Im{z} Im{z} 


Re{z} Re{z} Re{z} 
01⁄3 1 1⁄3 1 1/3 1 


ROC, ROC, ROC, 


FIGURE 4.5 The ROCs in Example 4.7 


a. ROC: 1 < |z| < co. Here both poles are on the interior side of the ROCi; 
that is, |z1| < Rz- = 1 and |z2| < 1. Hence from (4.15) 


which is a right-sided sequence. 


b. ROC»: 0 < |z| < z, Here both poles are on the exterior side of the ROC2; 
that is, |z1| > Rey = § and |z2| > 4. Hence from (4.15) 


n(n) = 5 {-u(-n—1)}- 5 {-(4)"u(-n-D} 


which is a left-sided sequence. 

c. ROCs: 4 < |z| < 1. Here pole zı is on the exterior side of the ROC3—that 
is, |z1| > Rs+ = 1—while pole z2 is on the interior side—that is, |z2| < L, 
Hence from (4.15) 


which is a two-sided sequence. 


4.3.1 MATLAB IMPLEMENTATION 
A MATLAB function residuez is available to compute the residue part 
and the direct (or polynomial) terms of a rational function in 27+. Let 


X(z 
( ag t+ ayz7b + tanz—N A(z 
N M-N 
Rk —k 
Sa 
k=1 k=0 
eS SS 
M>N 
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be a rational function in which the numerator and the denominator poly- 
nomials are in ascending powers of z~'. Then [R,p,C]=residuez(b,a) 
computes the residues, poles, and direct terms of X(z) in which two poly- 
nomials B(z) and A(z) are given in two vectors b and a, respectively. 
The returned column vector R contains the residues, column vector p 
contains the pole locations, and row vector C contains the direct terms. 


If p(k)=...=p(ktr-1) is a pole of multiplicity r, then the expansion in- 
cludes the term of the form 
R R Retr 
a Etl pf l y (4.16) 
1 — pez (1 — pz!) (1 = pp2-*) 


which is different from (4.14). 

Similarly, [b,a]=residuez(R,p,C), with three input arguments and 
two output arguments, converts the partial fraction expansion back to 
polynomials with coefficients in row vectors b and a. 


EXAMPLE 4.8 To check our residue calculations, let us consider the rational function 


z 
Xe) = 
= 32 at 
given in Example 4.7. 
Solution First rearrange X(z) so that it is a function in ascending powers of z~'. 
gO O+277 


xX — 
a ae ce rs ey ST 


Now using the MATLAB script 


>> b = [0,1]; a = [3,-4,1]; [R,p,C] = residuez(b,a) 


R= 
0.5000 
-0.5000 
y= 
1.0000 
0.3333 
ee 
0 
we obtain 
3 3 
X(z) i= fs 


3 
as before. Similarly, to convert back to the rational function form, 


>> [b,a] = residuez(R,p,C) 
be 

0.0000 

0.3333 
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a = 
1.0000 
333 
0.3333 
so that 
o+4271 Sa 
X(z) = 7 5 I = 7 2 352 = 
ee aa a a 3—4z-l+2z7- 322 — 4z + 1 
as before. 


EXAMPLE 4.9 Compute the inverse z-transform of 


1 
X(z)= 5 , l| > 0.9 
(1 —0.9z-1)* (1 + 0.92-1) 
Solution We will evaluate the denominator polynomial as well as the residues using the 


MATLAB script: 


>> b = 1; a = poly([0.9,0.9,-0.9]) 


As 
1.0000 -0.9000 -0.8100 0.7290 
>> [R,p,C]l=residuez(b,a) 
R = 
0.2500 
0.5000 
0.2500 
p= 
0.9000 
0.9000 
-0.9000 
es 
[] 


Note that the denominator polynomial is computed using MATLAB’s polyno- 
mial function poly, which computes the polynomial coefficients, given its roots. 
We could have used the conv function, but the use of the poly function is more 
convenient for this purpose. From the residue calculations and using the order 
of residues given in (4.16), we have 


2 : :2 
a AL E |z| > 0.9 


XxX ia 
(2) 1 — 0.9271 (1 —0.92-1)? 1 + 0.92771’ 


025 05, (0.92) 0.25 EST 
1—0.92-! " 0.9" (1 — 0.9771)? ` 1+0.9271 
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Hence from Table 4.1 and using the z-transform property of time-shift, 
K 
a(n) = 0.25(0.9)"u(n) + a(n + 1)(0.9)”+tu(n + 1) + 0.25 (—0.9)” u(n) 
which, upon simplification, becomes 
x(n) = 0.75(0.9)"u(n) + 0.5n(0.9)"u(n) + 0.25 (—0.9)” u(n) 
MATLAB verification: 


>> [delta,n] = impseq(0,0,7); x = filter(b,a,delta) % check sequence 
x= 
Columns 1 through 4 
1.00000000000000 0. 90000000000000 1.62000000000000 1.45800000000000 
Columns 5 through 8 
1.96830000000000 1.77147000000000 2.12576400000000 1.91318760000000 
>> x = (0.75)*(0.9).“n + (0.5)*n.*(0.9).^n + (0.25)*(-0.9).^n % answer sequence 
x= 
Columns 1 through 4 
1.00000000000000 0. 90000000000000 1.62000000000000 1.45800000000000 
Columns 5 through 8 
1.96830000000000 1.77147000000000 2.12576400000000 1.91318760000000 


EXAMPLE 4.10 Determine the inverse z-transform of 
1 + 0.42271 
x= + 0.4722 
1 — 0.82271 + 0.6427? 
so that the resulting sequence is causal and contains no complex numbers. 


Solution We will have to find the poles of X (z) in the polar form to determine the ROC 
of the causal sequence. 


MATLAB script: 


>> b = [1,0.4*sgrt(2)]; a=[1,-0.8*sqrt (2) ,0.64]; 
>> [R,p,C] = residuez(b,a) 
R S 
0.5000 1.0000i 
0.5000 + 1.0000i 
p= 
0.5657 + 0.5657i 
0.5657 0.5657i 
C= 


O 
>> Mp=(abs(p))’ % pole magnitudes 
Mp = 
0.8000 0.8000 
>> Ap=(angle(p))’/pi % pole angles in pi units 
Ap = 
0.2500 -0.2500 
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From these calculations 
0.5- j 
X(z) = — 
(2) 1—0.8et34 z-1 
and from Table 4.1, we have 


a(n) = (0.5 — j) 0.8"e*74"u(n) + (0.5 + j) 0.8"e E u(n) 


0.543 


1—0.8e747 27-1 


, |z| > 0.8 


0.8 [0.5{e "iE" 4 e447} — jfet Tn — ei En }u(n) 


0.8” [cos (=) + 2sin (=) u(n) 


MATLAB verification: 


>> [delta, n] = impseq(0,0,6); 
x = filter(b,a,delta) % check sequence 
x= 
Columns 1 through 4 
1.00000000000000 1.69705627484771 1.28000000000000 0.36203867196751 
Columns 5 through 8 
-0.40960000000000 -0.69511425017762 -0.52428800000000 -0.14829104003789 
>> x = ((0.8).^n).*(cos(pi*n/4)+2*sin(pi*n/4)) 
x= 
Columns 1 through 4 
1.00000000000000 1.69705627484771 1.28000000000000 0.36203867196751 
Columns 5 through 8 
-0.40960000000000 -0.69511425017762 -0.52428800000000 -0.14829104003789 


4.4 SYSTEM REPRESENTATION IN THE z-DOMAIN 
—— g 


Similar to the frequency response function H(ef®), we can define the 
z-domain function, H(z), called the system function. However, unlike 
H(e”), H(z) exists for systems that may not be BIBO stable. 


m DEFINITION] [The System Function] The system function H(z) is given by 


= 


H(z) = Z[h(n)] = h(n)”; Rp- < |2| < Rng (4.17) 


Using the convolution property (4.11) of the z-transform, the output 
transform Y(z) is given by 


Y(z) = H(z) X(z) : ROC, = ROC, N ROC, (4.18) 
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provided ROC, overlaps with ROC,. Therefore a linear and time- 
invariant system can be represented in the z-domain by 


X(z) —| H(z)|— Y(z) = A(z) X(z) 


4.4.1 SYSTEM FUNCTION FROM THE DIFFERENCE 
EQUATION REPRESENTATION 
When LTI systems are described by a difference equation 


N M 
y(n) + >) axy(n — k) =X bex(n — 4) (4.19) 
k=1 £=0 


the system function H(z) can easily be computed. Taking the z-transform 
of both sides, and using properties of the z-transform, 


N M 
Y(z)+ Se age "Y (2) = 5 bez *X(z) 
k=1 £=0 


SIO bez? _ B(2) 
X(2) 1+5] az A(z) 


= (4.20) 
After factorization, we obtain 


N 
H(z) = bo zN-M Mek = #) (4.21) 
T],=1(4 — Pr) 
where zes are the system zeros and p,’s are the system poles. Thus H(z) 
(and hence an LTI system) can also be represented in the z-domain using 
a pole-zero plot. This fact is useful in designing simple filters by proper 
placement of poles and zeros. 

To determine zeros and poles of a rational H(z), we can use the 
MATLAB function roots on both the numerator and the denominator 
polynomials. (Its inverse function poly determines polynomial coefficients 
from its roots, as discussed in the previous section.) It is also possible to 
use MATLAB to plot these roots for a visual display of a pole-zero plot. 
The function zplane(b,a) plots poles and zeros, given the numerator 
row vector b and the denominator row vector a. As before, the symbol o 
represents a zero and the symbol x represents a pole. The plot includes 
the unit circle for reference. Similarly, zplane(z,p) plots the zeros in 
column vector z and the poles in column vector p. Note very carefully the 
form of the input arguments for the proper use of this function. 
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4.4.2 TRANSFER FUNCTION REPRESENTATION 

If the ROC of H(z) includes a unit circle (z = ef% ), then we can evaluate 
H(z) on the unit circle, resulting in a frequency response function or 
transfer function H(e’”). Then from (4.21) 


H(i”) = bo iN- Me Lo (4.22) 


The factor (ef® — ze) can be interpreted as a vector in the complex z-plane 
from a zero z¢ to the unit circle at z = e/”, while the factor (e/” — pp) 
can be interpreted as a vector from a pole pp to the unit circle at z = e!”. 
This is shown in Figure 4.6. Hence the magnitude response function 


lel — z|- let — zag 


H(e”)| = |b - - 
| ( )| ol atoll 


(4.23) 


can be interpreted as a product of the lengths of vectors from zeros to the 
unit circle divided by the lengths of vectors from poles to the unit circle 
and scaled by |bo|. Similarly, the phase response function 


N 
ZH(e3”) =[0 or 7] + | + Lle — zp) Llet” — pp) 
(e) =] ] + [y 2 ae 
Constant Linear 
Nonlinear 
(4.24) 


can be interpreted as a sum of a constant factor, a linear-phase factor, 
and a nonlinear-phase factor (angles from the “zero vectors” minus the 
sum of angles from the “pole vectors” ). 


4.4.3 MATLAB IMPLEMENTATION 
In Chapter 3, we plotted magnitude and phase responses in MATLAB 
by directly implementing their functional forms. MATLAB also provides 


Im{z} 


FIGURE 4.6 Pole and zero vectors 
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a function called freqz for this computation, which uses the preceding 
interpretation. In its simplest form, this function is invoked by 


[H,w] = freqz(b,a,N) 


which returns the N-point frequency vector w and the N-point complex 

frequency response vector H of the system, given its numerator and de- 

nominator coefficients in vectors b and a. The frequency response is eval- 

uated at N points equally spaced around the upper half of the unit circle. 

Note that the b and a vectors are the same vectors we use in the filter 

function or derived from the difference equation representation (4.19). 
The second form 


[H,w] = freqz(b,a,N, ’whole’) 


uses N points around the whole unit circle for computation. 
In yet another form 


H = freqz(b,a,w) 


it returns the frequency response at frequencies designated in vector w, 
normally between 0 and 7. It should be noted that the freqz function can 
also be used for numerical computation of the DTFT of a finite-duration, 
causal sequence x(n). In this approach, b = x and a = 1. 


EXAMPLE 4.11 Given a causal system 
y(n) = 0.9y(n — 1) + x(n) 


a. Determine H(z) and sketch its pole-zero plot. 
b. Plot |H(e’”)| and ZH (e°). 
c. Determine the impulse response h(n). 


Solution The difference equation can be put in the form 


y(n) — 0.9y(n — 1) = a(n) 
a. From (4.21) 


1 


H(2) = ggz 


|z| > 0.9 


since the system is causal. There is one pole at 0.9 and one zero at the origin. 
We will use MATLAB to illustrate the use of the zplane function. 


>> b= [1, 0]; a = [1, -0.9]; zplane(b,a) 
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Pole—Zero Plot 
T 


Imaginary part 
oO 
T 
© 
X 
| 


} } i L } 
-1 -0.5 0 0.5 1 
Real Part 


FIGURE 4.7 Pole-zero plot of Example 4.11a 


Note that we specified b=[1,0] instead of b=1 because the zplane function 
assumes that scalars are zeros or poles. The resulting pole-zero plot is shown 
in Figure 4.7. 


b. Using (4.23) and (4.24), we can determine the magnitude and phase of 
H(e”). Once again we will use MATLAB to illustrate the use of the freqz 
function. Using its first form, we will take 100 points along the upper half of 
the unit circle. 


MATLAB Script: 


>> [H,w] = freqz(b,a,100); magH = abs(H); phaH = angle(H); 

>> subplot (2,1,1);plot(w/pi,magH) ; grid 

>> xlabel(’frequency in pi units’); ylabel(’Magnitude’) ; 

>> title(’Magnitude Response’) 

>> subplot (2,1,2);plot(w/pi,phaH/pi) ;grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi units’); 
>> title(’Phase Response’) 


The response plots are shown in Figure 4.8. If you study these plots carefully, 
you will observe that the plots are computed between 0 < w < 0.997 and 
fall short at w = m. This is due to the fact that in MATLAB the lower half 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 


Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


System Representation in the z-Domain 123 


Magnitude Response 
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an 
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L L L i L L 
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
frequency in x units 


-0.4 - - 
0 


FIGURE 4.8 Frequency response plots in Example 4.11 


of the unit circle begins at w = 7. To overcome this problem, we will use the 
second form of the freqz function as follows. 


>> [H,w] = freqz(b,a,200, whole’); 
>> magH = abs(H(1:101)); phaH = angle(H(1:101)); 


Now the 101st element of the array H will correspond to w = m. A similar 
result can be obtained using the third form of the freqz function. 


>> w = [0:1:100]*pi/100; H = freqz(b,a,w); 
>> magH = abs(H); phaH = angle(H); 


In the future we will use any one of these forms, depending on our conve- 
nience. Also note that in the plots we divided the w and phaH arrays by pi 
so that the plot axes are in the units of m and easier to read. This practice 
is strongly recommended. 


c. From the z-transform in Table 4.1 


1 
1 — 0.9271’ 


|z| > 0.9] = (0.9)"u(n) 


h(n) = 271 | 
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EXAMPLE 4.12 Given that 


z+1 


H(2) = -z097 7081 


is a causal system, find 


. its transfer function representation, 
. its difference equation representation, and 
its impulse response representation. 


aap 


Solution The poles of the system function are at z = 0.92 + 1/3. Hence the ROC of 
this causal system is |z| > 0.9. Therefore the unit circle is in the ROC, and the 
discrete-time Fourier transform H(e’“) exists. 


a. Substituting z = e” in H(z), 

Je 41 a e +1 
ei?» — 0.9e3» + 0.81 (ei® — 0.9eI7/3) (eit — 0.9e-57/3) 
b. Using H(z) = Y(z)/X(z), 


Y(z) _ z+1 (=) z4? 


H(e!”) = 


X) 22—0.92+0.81 \ 2-2) 1—0.92-! 40.8122 
Cross multiplying, 
Y (z) — 0.927" Y(z) + 0.81z2-?Y(z) = 271 X(z) +. 277 X(z) 


Now taking the inverse z-transform, 


y(n) — 0.9y(n — 1) + 0.81y(n — 2) = a(n — 1) + a(n — 2) 


or 


y(n) = 0.9y(n — 1) — 0.81y(n — 2) + x(n — 1) + x(n — 2) 
c. Using the MATLAB script, 


>> b = [0,1,1]; a = [1,-0.9,0.81]; [R,p,C] = residuez(b,a) 


R= 
-0.6173 - 0.9979i 
-0.6173 + 0.9979i 

D~ 

0.4500 + 0.7794i 

0.4500 - 0.7794i 
C= 

1.2346 
>> Mp = (abs(p))’ 
n = 


0.9000 0.9000 
>> Ap = (angle(p))’/pi 


0.3333 -0.3333 
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we have 


—0.6173 + j0.9979 | —0.6173 — 70.9979 
1—0.9e-37/3z-1 "1 —0.9ei7/3z-1 ’ 


H(z) = 1.2346 4 |z| > 0.9 


Hence from Table 4.1 


h(n) = 1.23466(n) + [(—0.6173 + j0.9979)0.9"e 27"/? 
+(—0.6173 — j0.9979)0.9” e17” ]u(n) 
= 1.23466(n) + 0.9” [—1.2346 cos(nrn/3) + 1.9958 sin(rn/3)ļu(n) 


= 0.9” [-1.2346 cos(mn/3) + 1.9958 sin(rn/3)ļu(n — 1) 


The last step results from the fact that h(0) = 0. 


4.4.4 RELATIONSHIPS BETWEEN SYSTEM REPRESENTATIONS 

In this and the previous two chapters, we developed several system rep- 
resentations. Figure 4.9 depicts the relationships among these representa- 
tions in a graphical form. 


H(z) 
| 


Express H(z) in Z1, 
cross multiply, and 
take inverse 


Take inverse 
z-transform 


Take 
z-transform, 
solve for Y/X 


Take 
z-transform 


| 
| 
| 
| 
| 
| ——-—-> 
| 
| 
| 
| 


Diff Equation h(n) 
_- 
7 
Substitute 7 } 
z=” / Take inverse / 
/ DTFT S 
{ I Paa i 
Take DTFT, I — <” Take Fourier 

solve for Y/X Hie!) Pag transform 


FIGURE 4.9 System representations in pictorial form 


4.4.5 STABILITY AND CAUSALITY 

For LTI systems, the BIBO stability is equivalent to X% |h(k)| < cv. 
From the existence of the discrete-time Fourier transform, this stability 
implies that H(e?”) exists, which further implies that the unit circle |z| = 
1 must be in the ROC of H(z). This result is called the z-domain stability 
theorem, therefore the dashed paths in Figure 4.9 exist only if the system 
is stable. 
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E THEOREM2 z-Domain LTI Stability 
An LTI system is stable if and only if the unit circle is in the ROC of 


For LTI causality we require that h(n) = 0, for n < 0 (i.e., a right- 
sided sequence). This implies that the ROC of H(z) must be outside some 
circle of radius Rp—. This is not a sufficient condition since any right-sided 
sequence has a similar ROC. However, when the system is stable, then its 
causality is easy to check. 


E THEOREM3 z-Domain Causal LTI Stability 
A causal LTI system is stable if and only if the system function H(z) 
has all its poles inside the unit circle. 


EXAMPLE 4.13 A causal LTI system is described by the following difference equation: 
y(n) = 0.8ly(n — 2) + x(n) — x(n — 2) 


Determine 


. the system function H(z), 

. the unit impulse response h(n), 

. the unit step response v(n), that is, the response to the unit step u(n), and 

. the frequency response function H(e’”), and plot its magnitude and phase 
over 0<w <T. 


aaor 


Solution Since the system is causal, the ROC will be outside a circle with radius equal 

to the largest pole magnitude. 

a. Taking the z-transform of both sides of the difference equation and then 

solving for Y(z)/X(z) or using (4.20), we obtain 
1-2? 1-2? 
H(z) = = : 
=a psig mei a-o ji AO 
b. Using the MATLAB script for the partial fraction expansion, 


>> b = [1,0,-1]; a = [1,0,-0.81]; [R,p,C] = residuez(b,a); 


R= 
-0.1173 
-0.1173 

p= 
-0.9000 

0.9000 
C= 
1.2346 
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we have 


1 1 
H(z) = 1.234 1 11 5 
(z) 346 — 0 Irog 0 CEET |z| > 0.9 


or from Table 4.1 
h(n) = 1.23466(n) — 0.1173 {1 + (—-1)"} (0.9)" u(n) 


c. From Table 4.1 Z[u(n)] = U(z) = |z| > 1. Hence 


1 
1—27 


(1+27t)(1-— 27!) f 1 
1 


JE jz] > 09N]z|>1 


(1 + 0.9271) (1 — 0.9271) Ewe 
-1 
~T a a —0.92-1)’ |z| > 0.9 
or 
V(z) = 1.0556 i — — 0.0556 z —, J| >0.9 
1 — 0.9271 1+0.92z-! 
Finally, 


v(n) = [1.0556(0.9)” — 0.0556 (—0.9)"] u(n) 


Note that in the calculation of V(z) there is a pole-zero cancellation at z = 1. 
This has two implications. First, the ROC of V(z) is still {|z| > 0.9} and not 
{|z| > 0.9N |z| > 1 = |z| > 1}. Second, the step response v(n) contains no 
steady-state term u(n). 


d. Substituting z = ef” in H(z), 


: 1 pon e i2w 
Aes ae 
(= 08e 


We will use the MATLAB script to compute and plot responses. 


>> w = [0:1:500]*pi/500; H = freqz(b,a,w); 

>> magH = abs(H); phaH = angle(H); 

>> subplot(2,1,1); plot(w/pi,magH); grid 

>> xlabel(’frequency in pi units’); ylabel(’Magnitude’) 

>> title(’Magnitude Response’ ) 

>> subplot (2,1,2); plot (w/pi,phaH/pi); grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi units’) 
>> title(’Phase Response’ ) 


The frequency response plots are shown in Figure 4.10. 
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Magnitude Response 
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FIGURE 4.10 Frequency response plots for Example 4.18 


4.5 SOLUTIONS OF THE DIFFERENCE EQUATIONS 
—_—_—————————— 


In Chapter 2 we mentioned two forms for the solution of linear constant 
coefficient difference equations. One form involved finding the particu- 
lar and the homogeneous solutions, while the other form involved find- 
ing the zero-input (initial condition) and the zero-state responses. Using 
z-transforms, we now provide a method for obtaining these forms. In ad- 
dition, we will also discuss the transient and the steady-state responses. 
In digital signal processing, difference equations generally evolve in the 
positive n direction. Therefore our time frame for these solutions will be 
n > 0. For this purpose we define a version of the bilateral z-transform 
called the one-sided z-transform. 


m DEFINITION 4 The One-sided z Transform 
The one-sided z-transform of a sequence x(n) is given by 


Z {x(n)u(n)] 2 xt [z] = 5 s(n)” (4.25) 


n=0 


I> 


Z" [2x(n)] 
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Then the sample shifting property is given by 


Zt [x(n —k)] = Z [x(n — k)u(n)] 


= 5 a(n—k)z "= 5 a(m)z~ tE) 
n=0 m=—k 
i o0 
= 5 r(m)z 70+) 4 y T aor 
m=-k m=0 


or 
Z+ [a(n — k)] = 2(—1)21-* +a(—-2)z?-* 4+. --4+a(—k) +27" X+(z) (4.26) 


This result can now be used to solve difference equations with nonzero 
initial conditions or with changing inputs. We want to solve the difference 
equation 


N M 
1+ 5° axy(n—k) = 5 bnxz(n—m),n>0 
k=1 m=0 
subject to these initial conditions: 
{y(i),i=—-1,...,-N} and {z(i) i= -—1,...,—-M}. 


We now demonstrate its solution using an example. 


EXAMPLE 4.14 Solve 


where 


subject to y(—1) = 4 and y(—2) = 10. 


Solution Taking the one-sided z-transform of both sides of the difference equation, we 
obtain 
oh 3 SEPS 1 —1 —2y-4+ a 1 
W@)= su Ute Ys zul) + Wo) +e Y (2) =a 
4 


Substituting the initial conditions and rearranging, 


eae oe 1 
2 2 1- iz! 


y+(z) E + (1 — 2272) 
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or 
= 
1-427 1-227) 
Y*(z)= 4 + 4.27 
e ee ra e A (420) 
Finally, 
2— 2z71 4 1,-2 
¥+@)=7 4 n 
G-te)a-s)0-e 
Using the partial fraction expansion, we obtain 
a 1 2 i 
Y = + —3 3 4.2 
(2) t—42-t 1-27! 1-47! 078) 
After inverse transformation the solution is 
INE 2D Lefty 
= f 4.2 
y(n) [(3) t3 aa) Jaw) (rea) 


Forms of the solutions The preceding solution is the complete re- 
sponse of the difference equation. It can be expressed in several forms. 


e Homogeneous and particular parts: 


Homogeneous part Particular part 


The homogeneous part is due to the system poles, and the particular 
part is due to the input poles. 


e Transient and steady-state responses: 


vin) =[7(F) +(5) Jum + Zur 


Transient response Steady-state response 


The transient response is due to poles that are inside the unit circle, 
whereas the steady-state response is due to poles that are on the unit 
circle. Note that when the poles are outside the unit circle, the response 
is termed an unbounded response. 


e Zero-input (or initial condition) and zero-state responses: 
In equation (4.27) Y*(z) has two parts. The first part can be inter- 
preted as 
Yz9(z) = H(z)X(z) 
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while the second part as 
Yz1(z) = H(z)Xrc(z) 


where Xzrc(z) can be thought of as an equivalent initial-condition in- 
put that generates the same output Yz; as generated by the initial 
conditions. In this example zzc(n) is 


xzro(n) = {1, -2} 
T 


Now taking the inverse z-transform of each part of (4.27), we write the 
complete response as 


y(n) =|; GG) 2 (5) + J u(n) + b (5) -2 u(n) 


Zero-state response Zero-input response 


From this example, it is clear that each part of the complete solution 
is, in general, a different function and emphasizes a different aspect of 
system analysis. 


4.5.1 MATLAB IMPLEMENTATION 

In Chapter 2 we used the filter function to solve the difference equation, 
given its coefficients and an input. This function can also be used to find 
the complete response when initial conditions are given. In this form the 
filter function is invoked by 


y = filter(b,a,x,xic) 


where xic is an equivalent initial-condition input array. To find the com- 
plete response in Example 4.14, we will use the MATLAB script 


>> n= [0:7]; x = (1/4).^n; xic = [1, -2]; 
>> format long; y1 = filter(b,a,x,xic) 
yis 
Columns 1 through 4 
2.00000000000000 1.25000000000000 0.93750000000000 0.79687500000000 
Columns 5 through 8 
0.73046875000000 0.69824218750000 0.68237304687500 0.67449951171875 
>> y2 = (1/3)*(1/4) .“n+(1/2) .“n+(2/3) *ones(1,8) % MATLAB Check 
y2 = 
Columns 1 through 4 
2.00000000000000 1.25000000000000 0.93750000000000 0.79687500000000 
Columns 5 through 8 
0.73046875000000 0.69824218750000 0.68237304687500 0.67449951171875 
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which agrees with the response given in (4.29). In Example 4.14 we com- 
puted xyc(n) analytically. However, in practice, and especially for large- 
order difference equations, it is tedious to determine x;c(n) analytically. 
MATLAB provides a function called filtic, which is available only in 
the Signal Processing toolbox. It is invoked by 


xic = filtic(b,a,Y,X) 


in which b and a are the filter coefficient arrays and Y and X are the initial- 
condition arrays from the initial conditions on y(n) and x(n), respectively, 
in the form 


Y = [y(-1), y(—2),.--, y(-N)] 
X = [x(-1), 2(-2),..., 2(-M)] 


Ifa(n) =0, n < —1 then X need not be specified in the filtic function. 
In Example 4.14 we could have used 


>> Y = [4, 10]; xic = filtic(b,a,Y) 
xic = 
-2 


to determine zrc(n). 


EXAMPLE 4.15 Solve the difference equation 


y(n) = 3 [x(n) + a(n — 1) + a(n — 2)] + 0.95y(n — 1) — 0.9025y(n — 2), n>0 
where x(n) = cos(mn/3)u(n) and 
y(-1) =-2, (-2)=-3; #(-1) =1, #(-2)=1 


First determine the solution analytically and then by using MATLAB. 


Solution Taking a one-sided z-transform of the difference equation 


Y*(z) = TAO) Hg(—1) +27 XT) +x(—2) +27 et) +27? XT) 
+ 0.95[y(—1) +27 ' Yt (z)] — 0.9025[y(—2) + 27! y(—1) + 27°Y + (2)] 
and substituting the initial conditions, we obtain 


Lpdg-h4 dz? 1.4742 + 2.138327! 


Y+(z)= +z) 

E E 

ded ost) = are aes) ow ee eS a 
jones me T i 3 ~ 12-14 272 


and simplifying, we will obtain Y*(z) as a rational function. This simplification 
and further partial fraction expansion can be done using MATLAB. 
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MATLAB script: 


>> b = [1,1,1]/3; a = [1,-0.95,0.9025]; 
SS Ve = |ISe sills x = [iil] E E a) 
xic = 


1.4742 2.1383 
>> bxplus [1,-0.5]; axplus = [1,-1,1]; % X(z) transform coeff. 
>> ayplus = conv(a,axplus) % Denominator of Yplus(z) 


ayplus = 
1.0000 -1.9500 2.8525 -1.8525 0.9025 
>> byplus = conv(b,bxplus)+conv(xic,axplus) % Numerator of Yplus(z) 
byplus = 
1.8075 0.8308 -0.4975 1.9717 
>> [R,p,C] = residuez(byplus,ayplus) 


mh = 

0.0584 + 3.9468i 0.0584 - 3.9468i 0.8453 + 2.0311i 0.8453 - 2.03111 
p= 

0.5000 - 0.8660i 0.5000 + 0.8660i 0.4750 + 0.8227i 0.4750 - 0.82271 
C= 

| 
>> Mp = abs(p), Ap = angle(p)/pi % Polar form 
Mp = 
1.0000 1.0000 0.9500 0.9500 

Ap = 


-0.3333 0.3333 0.3333 -0.3333 


Hence 


1.8075 + 0.830827! — 0.497527? + 1.971727? 
1 — 1.95z-1 + 2.85252-2 — 1.8525z-8 + 0.90252-4 


Y*(z) = 


_ 0.0584 + 73.9468 0.0584 — 73.9468 


1 — e-i7/3z-1 1 — eit /3z-1 


0.8453 + j2.0311 
1 — 0.9597 /3z-1 


0.8453 — 72.0311 
1 — 0.95e-37/3z-1 


Now from Table 4.1 

y(n) = (0.0584 + 73.9468) e717”? + (0.0584 — 73.9468) e17”? 

+ (0.8453 + 72.031) (0.95)" e77"/? + (0.8453 — 72.031) (0.95)” e 27"/8 
= 0.1169 cos(mn/3) + 7.8937 sin(an/3) 

+ (0.95)” [1.6906 cos(mn/3) — 4.0623 sin(rn/3)], n> 0 


The first two terms of y(n) correspond to the steady-state response, as well as 
to the particular response, while the last two terms are the transient response 
(and homogeneous response) terms. 

To solve this example using MATLAB, we will need the filtic function, 
which we have already used to determine the xrc(n) sequence. The solution 
will be a numerical one. Let us determine the first 8 samples of y(n). 
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MATLAB script: 


>> n = [0:7]; x = cos(pitn/3); y = filter(b,a,x,xic) 
y= 
Columns 1 through 4 
1.80750000000000 4.35545833333333 2.83975000000000 -1.56637197916667 
Columns 5 through 8 
-4.71759442187500 -3.40139732291667 1.35963484230469 5.02808085078841 
% Matlab Verification 
>> A=real(2*R(1)); B=imag(2*R(1)); C=real(2*R(3)); D=imag(2*R(4)) ; 
>> y=A*cos (pi*n/3)+B*sin(pi*n/3)+((0.95) .“n) .*(C*cos (pi*n/3)+D*sin(pi*n/3) ) 
y= 
Columns 1 through 4 
1.80750000000048 4.35545833333359 2.83974999999978 -1.56637197916714 
Columns 5 through 8 
-4.71759442187528 -3.40139732291648 1.35963484230515 5.02808085078871 


4.6 PROBLEMS 
—— g 


P4.1 Determine the z-transform of the following sequences using the definition (4.1). Indicate the 
region of convergence for each sequence and verify the z-transform expression using 
MATLAB. 


1. x(n) = {3,2, 1, —2, —3}. 
T 


x(n) = (0.8)"u(n — 2). Verify the z-transform expression using MATLAB. 
x(n) = [(0.5)” + (—0.8)”]u(n). Verify the z-transform expression using MATLAB. 
(n) = 2” cos(0.4mn)u(—n). 

) 


x(n) = (n+ 1)(3)"u(n). Verify the z-transform expression using MATLAB. 


an 


CORE ORIN 


P4.2 Consider the sequence x(n) = (0.9)” cos(mn/4)u(n). Let 
a(n/2), n = 0,+2,+4,---; 
y(n) = { (n/2) 


0, otherwise. 


1. Show that the z-transform Y (z) of y(n) can be expressed in terms of the z-transform 
X(z) of a(n) as Y(z) = X(z?). 

2. Determine Y (z). 

3. Using MATLAB, verify that the sequence y(n) has the z-transform Y (z). 


P4.3 Determine the z-transform of the following sequences using the z-transform table and the 
z-transform properties. Express X(z) as a rational function in z~'. Verify your results using 
MATLAB. Indicate the region of convergence in each case, and provide a pole-zero plot. 


1. a(n) = 26(n — 2) + 3u(n — 3) 
2. x(n) = 3(0.75)” cos(0.37n)u(n) + 4(0.75)” sin(0.37n)u(n) 
3. x(n) = nsin(=*)u(n) + (0.9)"u(n — 2) 
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4. a(n) = n? (2/3) u(n — 1) 
5. a(n) = (n— ceo hea cos{3 (n — 1)}u(n) 
P4.4 Let x(n) be a complex-valued sequence with the real part zr(n) and the imaginary part 
xy(n). 
1. Prove the following z-transform relations: 
X(z) + X"(2") 
2 
2. Verify these relations for x(n) = exp {(—1 + j0.27)n} u(n). 


X(z) — X"(2") 


and X;(z) Ê Z [a1(n)] = > 


Xn(z) Ê Z [er(n)] = 


P4.5 The z-transform of x(n) is X(z) = 1/(1 + 0.5z7}), |z| > 0.5. Determine the z-transforms of 
the following sequences and indicate their region of convergence. 


1. a(n) = 2(3 —n) + z(n-— 3) 
2. ta(n) = (1+ n+n’)x(n) 

3. x3(n) = ($)"2(n — 2) 

4. xa(n) = x(n + 2) x x(n — 2) 
5. &5(n) = cos(mn/2)a*(n) 


P4.6 Repeat Problem P4.5 if 


E T sl 
_ - hy 
14 32-14 42-2 


X(2) ; 


P4.7 The inverse z-transform of X (z) is x(n) = (1/2)"u(n). Using the z-transform properties, 
determine the sequences in each of the following cases. 


Xi(z) = 2-1 X(z) 
2X(z7*) 
X3(z) = 2X (3z) + 3X(z/3) 


Xa(z) = X(z)X(z7") 


Ct ie NS 


P4.8 If sequences x1(n), r2(n), and x3(n) are related by x3(n) = x1(n) x x(n), then 


` x3(n) = ( m nto) ( D sto) 


n=—oo n=—co n=—oco 


1. Prove this result by substituting the definition of convolution in the left-hand side. 

2. Prove this result using the convolution property. 

3. Verify this result using MATLABand choosing any two random sequences x1(n), and 
x2(n). 


P4.9 Determine the results of the following polynomial operations using MATLAB. 
1. Xi(z) = (l= 2271 +3277 = 4273) (44-3271 =~ 22-7 + 279) 


2. Xo(z) = (2? — 22 £34 2271 + 27-7)(2? = 273) 

3. X3(z) = (142427) 

4. X4(z) = X1(z)X2(z) + X3(z) 

5. Xs(z) = (z7! — 3z 22°F 4 52-F = 279) (e432? +2234 474) 
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P4.10 The deconv function is useful in dividing two causal sequences. Write a MATLAB function 
deconv_m to divide two noncausal sequences (similar to the conv function). The format of 
this function should be 


function [p,np,r,nr] = deconv_m(b,nb,a,na) 
% Modified deconvolution routine for noncausal sequences 
% function [p,np,r,nr] = deconv_m(b,nb,a,na) 


% p = polynomial part of support npi <= n <= np2 

% np = [npi, np2] 

% r = remainder part of support nri <= n <= nr2 

% nr = [nri, nr2] 

% b = numerator polynomial of support nb1 <= n <= nb2 

% nb = [nbi, nb2] 

% a = denominator polynomial of support nal <= n <= na2 
% na = [nai, na2] 


Check your function on the following operartion 


3272 +3273 
AEE 


z2 +z+1+2z7 +z? +2 
z#¥ 2427! 


= (z= 1482 —2z7°) + 


P4.11 Determine the following inverse z-transforms using the partial fraction expansion method. 


1. Xi(z) = (1—27 — 427? +427°)/(1— Bat + 1327? +z °). The sequence is rightsided. 


2. X2(z) = (1 +27} — 4277 4.427%) /(1— 4271 + B27? — 427°). The sequence is 
absolutely summable. 


3. X3(z) = (2? — 327 + 4z + 1)/(2? — 42? + z — 0.16). The sequence is leftsided. 
4. X4(z) = z/(2 + 227 + 1.252 + 0.25), |z| > 1 
5. X5(z) = z/(z? — 0.25)”, |z| < 0.5 


P4.12 Consider the sequence 
x(n) = Ac(r)” cos(nvon)ju(n) + As(r)” sin(rvon)u(n) (4.30) 


The z-transform of this sequence is a 2-order (proper) rational function that contains a 
complex-conjugate pole pair. The objective of this problem is to develop a MATLAB 
function that can be used to obtain the inverse z-transform of such a rational function so 
that the inverse does not contain any complex numbers. 


1. Show that the z-transform of x(n) in (4.30) is given by 


bo + biz! ; 
1+aj,z7! + agz72’ 


X(z)= jz| > |r| (4.31) 


where 


bo = Ac; bi = r[As sin(nvo) — Ac cos(mtvo)]; a1 = —2r cos(mv9); az = r° (4.32) 
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2. Using (4.32), determine the signal parameters Ac, As, r, and vo in terms of the rational 
function parameters bo, b1, ai, and a2. 

3. Using your results in part b above, design a MATLABfunction, invCCPP, that computes 
signal parameters using the rational function parameters. The format of this function 
should be: 


function [As,Ac,r,v0] = invCCPP(b0,b1,ai,a2) 


P4.13 Suppose X(z) is given as follows: 


2+32z71 
1—2-1+0.81z2- 
1. Using the MATLABfunction invCCPP given in Problem P4.12, determine x(n) in a form 
that contains no complex numbers. 
2. Using MATLAB, compute the first 20 samples of x(n), and compare them with your 
answer in the above part. 


X(z) = x |z| > 0.9 


P4.14 The z-transform of a causal sequence is given as 


—2 + 5.6527! — 2.8827? 


X (z) = 4. 
(2) = cgi + 0.092-? + 0.6482-3 (3:33) 
which contains a complex-conjugate pole pair as well as a real-valued pole. 
1. Using the residuez function express (4.33) as 
—1 
e EA N C) (4.34) 


T+ et et TFC e 


Note that you will have to use the residuez function in both directions. 

2. Now using your function invCCPP and the inverse of the real-valued pole factor, 
determine the causal sequence x(n) from the X(z) in (4.34) so that it contains no 
complex numbers. 


P4.15 For the linear and time-invariant systems described by the following impulse responses, 


determine (i) the system function representation, (ii) the difference equation representation, 


(iii) the pole-zero plot, and (iv) the output y(n) if the input is x(n) = (4)" u(n). 


1. h(n) = 51/4) u(n) 

2. h(n) = n(1/3)"u(n) + (—1/4)”" u(n) 

3. h(n) = 3(0.9)” cos(an/4 + 7/3)u(n + 1) 
sk 


0.5)” sin[(n + 1)7/3] ie) 
sin(7/3) 


5. h(n) = [2 — sin(an)]u(n) 


4. h(n) 


P4.16 Consider the system shown below. 


1. Using the z-transform approach, show that the impulse response, h(n), of the overall 
system is given by 


OOE Zola zi 
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l s 
h(n) = 4 n -2)- ôn- 1) 


x(n 


n 
min=| = u(n) y(n) 


2. Determine the difference equation representation of the overall system that relates the 
output y(n) to the input x(n). 

3. Is this system causal? BIBO stable? Explain clearly to receive full credit. 

4. Determine the frequency response H(e?”) of the overall system. 

5. Using MATLAB, provide a plot of this frequency response over 0 < w < T. 


P4.17 For the linear and time-invariant systems described by the following system functions, 
determine (i) the impulse response representation, (ii) the difference equation 
representation, (iii) the pole-zero plot, and (iv) the output y(n) if the input is 
x(n) = 3cos(mn/3)u(n). 

1. H(z) = (z + 1)/(z — 0.5), causal system 
2. H(z) =(14+27'+277)/( + 0.5271 — 0.2527"), stable system 
3. H(z) = (2° — 1)/(z — 3), anticausal system 
z 1 — 0.527" 
z — 0.25 142271 
5. H(z) =(4+27' +277)? 


4. H(z) = 


, stable system 


P4.18 For the linear, causal, and time-invariant systems described by the following difference 
equations, determine (i) the impulse response representation, (ii) the system function 
representation, (iii) the pole-zero plot, and (iv) the output y(n) if the input is 
x(n) = 2(0.9)"u(n). 


1. y(n) = [x(n) + 2a(n — 1) + a(n — 3)] /4 

2. y(n) = x(n) + 0.52(n — 1) — 0.5y(n — 1) + 0.25y(n — 2) 

3. y(n) = 2x(n) + 0.9y(n — 1) 

4. y(n) = —0.45x(n) — 0.4a(n — 1) + a(n — 2) + 0.4y(n — 1) + 0.45y(n — 2) 


5. y(n) = X$ _,(0.8)™a(n — m) — Y5 (0.9) y(n — £) 


P4.19 The output sequence y(n) in Problem P4.18 is the total response. For each of the systems 
given in Problem P4.18, separate y(n) into (i) the homogeneous part, (ii) the particular 
part, (iii) the transient response, and (iv) the steady-state response. 


P4.20 A stable system has four zeros and four poles as given here: 


zeros: +1, +j1 Poles: + 0.9, +40.9 
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It is also known that the frequency response function H (e°) evaluated at w = 7/4 is equal 
to 1, i.e., 


H(e!7/4) =1 


1. Determine the system function H(z), and indicate its region of convergence. 

2. Determine the difference equation representation. 

3. Determine the steady-state response yss(n) if the input is x(n) = cos(mn/4)u(n). 
4. Determine the transient response ytr(n) if the input is x(n) = cos(mn/4)u(n). 


P4.21 A digital filter is described by the frequency response function 
H (e°) = [1 + 2cos(w) + 3 cos(2w)] cos (5) eer 


1. Determine the difference equation representation. 

2. Using the freqz function, plot the magnitude and phase of the frequency response of the 
filter. Note the magnitude and phase at w = 7/2 and at w = r. 

3. Generate 200 samples of the signal x(n) = sin(mn/2) + 5cos(an), and process through 
the filter to obtain y(n). Compare the steady-state portion of y(n) to x(n). How are the 
amplitudes and phases of two sinusoids affected by the filter? 


P4.22 Repeat Problem 4.21 for the following filter 


1te 7 
1 — 0.8145e—-34¥ 


H(t) = 


P4.23 Solve the following difference equation for y(n) using the one-sided z-transform approach. 


y(n) = 0.8ly(n — 2) + a(n) —a(n—1), n> 0;  y(—1) = 2, y(—2) = 2 
= (0.7)"u(n + 1) 


R 
Š 
| 


Generate the first 20 samples of y(n) using MATLAB, and compare them with your answer. 


P4.24 Solve the difference equation for y(n), n > 0 


y(n) — 0.4y(n — 1) — 0.45y(n — 2) = 0.452(n) + 0.42(n — 1) — x(n — 2) 


driven by the input x(n) = [2 + (3)"] u(n) and subject to 


y(-1) = 0, y(—2) = 3; x(-1) = z(-2) = 2 


Decompose the solution y(n) into (i) transient response, (ii) steady-state response, (iii) 
zero-input response, and (iv) zero-state response. 
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P4.25 A stable, linear and time-invariant system is given by the following system function 


_ 42? — 2/2241 
z2 —2/2z4+4 


Determine the difference equation representation for this system. 

Plot the poles and zeros of H(z), and indicate the ROC. 

Determine the unit sample response h(n) of this system. 

Is this system causal? If the answer is yes, justify it. If the answer is no, find a causal 
unit sample response that satisfies the system function. 


H(z) 


er BD ke 


P4.26 Determine the zero-input, zero-state, and steady-state responses of the system 
y(n) = 0.9801ly(n — 2) + x(n) + 2a(n — 1) +. a(n — 2), n > 0; y(—2) =1, y(—1) =0 


to the input x(n) = 5(—1)"u(n). 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


CHAPTER 


The Discrete 
Fourier Transform 


In Chapters 3 and 4 we studied transform-domain representations of dis- 
crete signals. The discrete-time Fourier transform provided the frequency- 
domain (w) representation for absolutely summable sequences. The 
z-transform provided a generalized frequency-domain (z) representation 
for arbitrary sequences. These transforms have two features in common. 
First, the transforms are defined for infinite-length sequences. Second, 
and the most important, they are functions of continuous variables (w 
or z). From the numerical computation viewpoint (or from MATLAB’s 
viewpoint), these two features are troublesome because one has to evalu- 
ate infinite sums at uncountably infinite frequencies. To use MATLAB, we 
have to truncate sequences and then evaluate the expressions at finitely 
many points. This is what we did in many examples in the two previous 
chapters. The evaluations were obviously approximations to the exact 
calculations. In other words, the discrete-time Fourier transform and the 
z-transform are not numerically computable transforms. 

Therefore we turn our attention to a numerically computable trans- 
form. It is obtained by sampling the discrete-time Fourier transform in the 
frequency domain (or the z-transform on the unit circle). We develop this 
transform by first analyzing periodic sequences. From Fourier analysis we 
know that a periodic function (or sequence) can always be represented by 
a linear combination of harmonically related complex exponentials (which 
is a form of sampling). This gives us the discrete Fourier series (DFS) rep- 
resentation. Since the sampling is in the frequency domain, we study the 
effects of sampling in the time domain and the issue of reconstruction in 
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the z-domain. We then extend the DFS to finite-duration sequences, which 
leads to a new transform, called the discrete Fourier transform (DFT). 
The DFT avoids the two problems mentioned and is a numerically com- 
putable transform that is suitable for computer implementation. We study 
its properties and its use in system analysis in detail. The numerical com- 
putation of the DFT for long sequences is prohibitively time-consuming. 
Therefore several algorithms have been developed to efficiently compute 
the DFT. These are collectively called fast Fourier transform (or FFT) 
algorithms. We will study two such algorithms in detail. 


5.1 THE DISCRETE FOURIER SERIES 
—— g 


In Chapter 2 we defined the periodic sequence by (n), satisfying the 
condition 
T(n) = (n+ kN), Vn,k (5.1) 


where N is the fundamental period of the sequence. From Fourier analysis 
we know that the periodic functions can be synthesized as a linear com- 
bination of complex exponentials whose frequencies are multiples (or har- 
monics) of the fundamental frequency (which in our case is 2r /N). From 
the frequency-domain periodicity of the discrete-time Fourier transform, 
we conclude that there are a finite number of harmonics; the frequencies 
are {27 k, k =0,1,...,N—1}. Therefore a periodic sequence &(n) can 
be expressed as 


LAG e 
čín) = 7 X (k) TE, n= 0,1,..., (5.2) 
k=0 
where {X (k), k= 0,1,...,} are called the discrete Fourier series co- 
efficients, which are given by 
- N-1 3 
X(k)= X ee iE, k=0,41,..., (5.3) 
n=0 


Note that X (k) is itself a (complex-valued) periodic sequence with fun- 
damental period equal to N, that is, 


X(k+.N) = X(k) (5.4) 


The pair of equations (5.3) and (5.2), taken together, is called the discrete 
Fourier series representation of periodic sequences. Using Wy = e~/* to 
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denote the complex exponential term, we express (5.3) and (5.2) as 


& N-1 
X(k) Ê DFS[#(n)] = 5 (n) wg : Analysis or a 
n=0 DFS equation 
2 A = 1 N—! . -nk ; : 
&(n) = IDFS[X(k)] = N 5X X(k)Wg : Synthesis or an inverse 
k=0 DFS equation 
(5.5) 
EXAMPLE 5.1 Find DFS representation of the periodic sequence 
tm) = f0 1,23 0 h23 0123 
ji 
Solution The fundamental period of this sequence is N = 4. Hence W4 = eiT = 
—j. Now 
3 
Š (k) = So ē(n)W?", k=0,+1,2, 
n=0 
Hence 
3 3 
X(0) = So a(n)w2” = N° a(n) = &(0) + 2(1) + &(2) + (8) = 6 
0 0 
Similarly, 


0 
3 3 

X(2) = So &(n)We" = S>a(n)(-3)"" = 2 
0 0 


5.1.1 MATLAB IMPLEMENTATION 

A careful look at (5.5) reveals that the DFS is a numerically computable 
representation. It can be implemented in many ways. To compute each 
sample X (k), we can implement the summation as a for...end loop. 
To compute all DFS coefficients would require another for. ..end loop. 
This will result in a nested two for...end loop implementation. This is 
clearly inefficient in MATLAB. An efficient implementation in MATLAB 
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would be to use a matrix-vector multiplication for each of the relations 
in (5.5). We have used this approach earlier in implementing a numerical 
approximation to the discrete-time Fourier transform. Let x and X denote 
column vectors corresponding to the primary periods of sequences (n) 
and X(k), respectively. Then (5.5) is given by 


X = Wyx 
eee: eee (5.6) 


n— 
1 1 . 1 
F 1 Wh . WW? 
Ww £ [WE onnen] = te a ee (5.7) 


1 wE» o. woo? 


The matrix Wy is a square matrix and is called a DFS matriz. The 
following MATLAB function dfs implements this procedure. 


function [Xk] = dfs(xn,N) 

% Computes Discrete Fourier Series Coefficients 

OP ata a ee 

% [Xk] = dfs(xn,N) 

% Xk = DFS coeff. array over 0 <= k <= N-1 

% xn = One period of periodic signal over 0 <= n <= N-1 
% N = Fundamental period of xn 


h 

n = [(0:1:N-1]; %, row vector for n 

k = [0:1:N-1]; % row vecor for k 

WN = exp(-j*2*pi/N) ; % Wn factor 

nk = n’*k; % creates a N by N matrix of nk values 
WNnk = WN .^ nk; % DFS matrix 

Xk = xn * WNnk; % row vector for DFS coefficients 


The DFS in Example 5.1 can be computed using MATLAB as 


>> xn = [0,1,2,3]; N = 4; Xk = dfs(xn,N) 
Xk = 
6.0000 -2.0000 + 2.0000i -2.0000 - 0.0000i -2.0000 - 2.0000i 
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The following idfs function implements the synthesis equation. 


function [xn] = idfs(Xk,N) 

% Computes Inverse Discrete Fourier Series 

OD eet oar a 

% [xn] = idfs(Xk,N) 

% xn = One period of periodic signal over 0 <= n <= N-1 
% Xk = DFS coeff. array over 0 <= k <= N-1 

% N = Fundamental period of Xk 


n = [0:1:N-1]; %, row vector for n 

k = [0:1:N-1]; %, row vecor for k 

WN = exp(-j*2*pi/N) ; % Wn factor 

nk = n’*k; % creates a N by N matrix of nk values 
WNnk = WN .* (-nk); % IDFS matrix 

xn = (Xk * WNnk)/N; %, row vector for IDFS values 


Caution: These functions are efficient approaches of implementing (5.5) 
in MATLAB. They are not computationally efficient, especially for large 
N. We will deal with this problem later in this chapter. 


EXAMPLE 5.2 A periodic “square wave” sequence is given by 

A 1, mN<n<mN+L-1 

&(n) = 
0, mN+L<n<(m+1)N-1 


m =0,+1,+2,... 


where N is the fundamental period and L/N is the duty cycle. 


a. Determine an expression for |X(k)| in terms of L and N. 

b. Plot the magnitude |X (k)| for L = 5, N = 20; LD = 5, N = 40; L = 5, 
N = 60; and L=7, N = 60. 

c. Comment on the results. 


Solution A plot of this sequence for L = 5 and N = 20 is shown in Figure 5.1. 


Three Periods of xtilde(n) 
1 5 T T T 


= 
L 


xtilde 
O 
[n] 
T 
L 


-0.5 L 1 1 1 L 
-20 -10 0 10 20 30 
n 


FIGURE 5.1 Periodic square wave sequence 
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a. By applying the analysis equation (5.3), 


N-1 L-1 L—1 


t 
bas 
= 
2 
II 
Rr 
5 
3 
So. 
® 
J 
ho 
is 
3 
> 
II 
iM] 
o 
d 
N 
is 
3 
> 
II 
~~ 
o 
d 
N 
È 
> 
NY 
3 


1 — enon Lk/N 
Ta en J2rk/N ”? otherwise 
The last step follows from the sum of the geometric terms formula (2.7) in 
Chapter 2. The last expression can be simplified to 


1 — en d27Lk/N 7 en ITLk/N QinLk/N _ p-iTLk/N 
1 — e-i2ak/N e-itk/N — ejnk/N — e-jnk/N 
_ eit (L-1)k/N sin (tkL/N) 
sin (tk/N) 
or the magnitude of X(k) is given by 
L, k=0,4N,+2N,... 
|X()| = 4 | sin (nkL/N) 
a therwi 
sin (wk/N) |’ otherwise 
b. The MATLAB script for L = 5 and N = 20: 
>> L = 5; N = 20; k = [-N/2:N/2]; % Sq wave parameters 
>> xn = [ones(1,L), zeros(1,N-L)]; % Sq wave x(n) 
>> Xk = dfs(xn,N); % DFS 


>> magXk = abs ([Xk(N/2+1:N) Xk(1:N/2+1)]); % DFS magnitude 
>> subplot(2,2,1); stem(k,magXk); axis([-N/2,N/2,-0.5,5.5]) 
>> xlabel(’k’); ylabel(’ Xtilde(k) >) 

>> title(’DFS of SQ. wave: L=5, N=20’) 


The plots for this and all other cases are shown in Figure 5.2. Note that 
since X(k) is periodic, the plots are shown from —N/2 to N/2. 

c. Several interesting observations can be made from plots in Figure 5.2. The 
envelopes of the DFS coefficients of square waves look like “sinc” functions. 
The amplitude at k = 0 is equal to L, while the zeros of the functions are 
at multiples of N/L, which is the reciprocal of the duty cycle. We will study 
these functions later in this chapter. 


5.1.2 RELATION TO THE zTRANSFORM 
Let x(n) be a finite-duration sequence of duration N such that 


Nonzero, O<n<N-1 


(5.8) 
0, Elsewhere 


x(n) = 
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DFS of Sq. wave: L=5, N=20 DFS of Sq. wave: L=5, N=40 
5 Ọ 5 
4 4 
F3 3 
ke] ke] 
x2 x2 
1 1 
eT te refer este 
0 0 
-10 -5 0 5 10 -20 -10 0 10 20 
k k 
DFS of Sq. wave: L=7, N=60 
6 g 
T 
D4 
2 
x 
2 
0 
-20 0 20 
k 


FIGURE 5.2 The DFS plots of a periodic square wave for various L and N 


Then we can compute its z-transform: 


N-1 


X(z) = So a(n)z™ (5.9) 


n=0 


Now we construct a periodic sequence &(n) by periodically repeating x(n) 
with period JN, that is, 


Z(n),0<n<N-1 


= 5.10 
wu 0, Elsewhere ( ) 
The DFS of &(n) is given by 
7 N-t N-1 iii 
X(k) = Do č(ne ¥en) [e] (5.11) 
n=0 n=0 
Comparing it with (5.9), we have 
X= Xg (5.12) 


which means that the DFS X (k) represents N evenly spaced samples of 
the z-transform X (z) around the unit circle. 
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5.1.3 RELATION TO THE DTFT 
Since x(n) in (5.8) is of finite duration of length N, it is also absolutely 
summable. Hence its DTFT exists and is given by 


: N-1 ; N-1 ; 
X(e3%) = u(nje 72" = yi Z(n)e I%” (5.13) 
n=0 n=0 


Comparing (5.13) with (5.11), we have 


X(k) = X(e%*)| ae, (5.14) 
N 
Let ; 3 
A A iT 
y= N and Wk = WE = kw 


Then the DFS X(k) = X(e/**) = X(e/*“1), which means that the DFS is 
obtained by evenly sampling the DTFT at wı = 2r intervals. From (5.12) 
and (5.14) we observe that the DFS representation gives us a sampling 
mechanism in the frequency domain that, in principle, is similar to sam- 
pling in the time domain. The interval wı = 2r is the sampling interval 
in the frequency domain. It is also called the frequency resolution because 


it tells us how close the frequency samples (or measurements) are. 


EXAMPLE 5.3 Let a(n) = {0, 1, 2,3}. 
T 


a. Compute its discrete-time Fourier transform X(e?”). 
b. Sample X(e?”) at kwı = 22k, k = 0,1,2,3 and show that it is equal to 
X(k) in Example 5.1. 


Solution The sequence x(n) is not periodic but is of finite duration. 


a. The discrete-time Fourier transform is given by 


X(t”) = Dp z(n)e jon — e JM 4 6 j2w 4 3e713” 


n=—co 


b. Sampling at kw; = k, k = 0, 1,2,3, we obtain 


X(e®) = 1+2 +3 = 6 = X (0) 
NEPA) = eI e Tt ge i a=) 
X (e1474) = e F47/4 4 oe ISTE | geI ng X(2) 
X(eFo"/4) = e7I6T/4 1 2e7i1?T/4 1 3e7It87/4 = _9 — 2j = X(3) 


as expected. 
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5.2 SAMPLING AND RECONSTRUCTION IN THE z-DOMAIN 
—— g 


Let x(n) be an arbitrary absolutely summable sequence, which may be of 
infinite duration. Its z-transform is given by 


m=— oo 


and we assume that the ROC of X (z) includes the unit circle. We sample 
X (z) on the unit circle at equispaced points separated in angle by wı = 
27/N and call it a DFS sequence, 


Š (k) Ê X(2)| _ sages k =0,+1,+2,... 
= J ame itm Y e(mwg" (5.15) 


which is periodic with period N. Finally, we compute the IDFS of X (k), 
ž(n) = IDFS[X(k)] 


which is also periodic with period N. Clearly, there must be a relationship 
between the arbitrary x(n) and the periodic (n). This is an important 
issue. In order to compute the inverse DTFT or the inverse z-transform 
numerically, we must deal with a finite number of samples of X (z) around 
the unit circle. Therefore we must know the effect of such sampling on 
the time-domain sequence. This relationship is easy to obtain. 


&(n) = } SX ewe [from (5.2)] 
k= 


N-1 lee) 
=x 5 sowie [from (5.15)] 


k=0 \m=—oo 
or 
oo N-1 oo oo 
2) 5 x(m) D aaa = >D x(m) 5 6(n—m—rN) 
m=—oo 0 m=—oo r=—00 
E n n-m=rN 
0, elsewhere 


= 5 5 x(m)é(n —-m—rN) 
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or 


Z(n) = 5 z(n—rN)=---+a(n+N)+a(n)+a(n—N)+--- (5.16) 


r=— oo 


which means that when we sample X (z) on the unit circle, we obtain a 
periodic sequence in the time domain. This sequence is a linear combina- 
tion of the original x(n) and its infinite replicas, each shifted by multiples 
of +N. This is illustrated in Example 5.5. From (5.16), we observe that if 
x(n) = 0 for n < 0 and n > N, then there will be no overlap or aliasing in 
the time domain. Hence we should be able to recognize and recover x(n) 
from £(n), that is, 


x(n) = (n) for0 <n < (N — 1) 


or 
E(n),0<n<N-1 
0, else 


x(n) = &(n)Ryp(n) = 


where Ry(n) is called a rectangular window of length N. Therefore we 
have the following theorem. 


E THEOREM1 Frequency Sampling 
If x(n) is time-limited (i.e., of finite duration) to [0, N — 1], then N 
samples of X(z) on the unit circle determine X (z) for all z. 


EXAMPLE 5.4 Let xı(n) = {6,5, 4,3,2,1}. Its DTFT X1(e’”) is sampled at 
T 


wr = £, k=0,+1,+2,43,... 


to obtain a DFS sequence Xo(k). Determine the sequence #2(n), which is the 
inverse DFS of X2(k). 


Solution Without computing the DTFT, the DFS, or the inverse DFS, we can evaluate 
&2(n) by using the aliasing formula (5.16). 
&2(n) = LS xi(n — 4r) 


Thus (4) is aliased into z(0), and «(5) is aliased into x(1). Hence 


%o(n) = {...,8,6,4, 3,8, 6, 4,3, 8, 6, 4,3,...} 
T 
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EXAMPLE 5.5 Let x(n) = (0.7)” u(n). Sample its z-transform on the unit circle with N = 5, 
10, 20, 50 and study its effect in the time domain. 


Solution From Table 4.1 the z-transform of x(n) is 
1 Z z 
1— 0.727}  z-0.7’ 
We can now use MATLAB to implement the sampling operation 
X(k) = A (ell i ciank/N 5 k=0,+1,+2,... 


and the inverse DFS computation to determine the corresponding time-domain 
sequence. The MATLAB script for N = 5 is as follows. 


X(z) = |z| > 0.7 


>> N = 5; k = 0:1:N-1; % sample index 

>> wk = 2*pi*k/N; zk = exp(j*wk); % samples of z 

>> Xk = (zk) ./(zk-0.7); % DFS as samples of X(z) 
>> xn = real(idfs(Xk,N)); % IDFS 


>> xtilde = xn’* ones(1,8); xtilde = (xtilde(:))’; % Periodic sequence 
>> subplot(2,2,1); stem(0:39,xtilde) ;axis([0,40,-0.1,1.5]) 
>> xlabel(’n’); ylabel(’xtilde(n)’); title(’N=5’) 


The plots in Figure 5.3 clearly demonstrate the aliasing in the time domain, 
especially for N = 5 and N = 10. For large values of N the tail end of x(n) 


TTR Fra elie 


FIGURE 5.3 Plots in Example 5.5 
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is sufficiently small to result in any appreciable amount of aliasing in practice. 
Such information is useful in effectively truncating an infinite-duration sequence 
prior to taking its transform. 


5.2.1 THE z TRANSFORM RECONSTRUCTION FORMULA 
Let x(n) be time-limited to [0, N — 1]. Then from Theorem 1 we should 
be able to recover the z-transform X(z) using its samples X(k). This is 
given by 


X(z) = Z [2(n)] = Z[z(n)Ryn(n)| 
= Z(IDFS{ X(k)  }Ry(n)| 
MN” 
Samples of X(z) 


This approach results in the z-domain reconstruction formula. 


X(z) = 5 a(n)z-" = >D T(n)” 


1 N-1 F N-1 
= > Xk) 3 Wye” a 
k=0 0) 
1 N-1 R N-1 a 
= X(h) 2 (Wy*27") 
k=0 0 


a y ee (5.17) 


5.2.2 THE DTFT INTERPOLATION FORMULA 
The reconstruction formula (5.17) can be specialized for the discrete-time 
Fourier transform by evaluating it on the unit circle z = e?”. Then 


go a a X(k) 
X(e"*) = N D 1 — ej2rk/N e7 jw 
k=0 
N-1 
Z J- —jwN 
X(k) : 


N {1 ce ef aak/N e— ju \ 


> 
ll 
(=; 
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Consider 


1 — eTieN 1 — eS FN 


Oo e jy (w— ARF sin [(w — 2k) N] 
-eT 35(~—-78®) \ Nsin [(w — 22%) 3] 
Let 
(w) = mF) pjo) : an interpolating function (5.18) 
N sin($) 
Then 
; AE 2rk 
xli y la (a = 7) (5.19) 
k=0 


This is the DTFT interpolation formula to reconstruct X(e?”) from its 
samples X (k). Since ®(0) = 1, we have that X(e/?™*/N) = X(k), which 
means that the interpolation is exact at sampling points. Recall the 
time-domain interpolation formula (3.33) for analog signals: 


oO 


Talt) = X` x(n)sinc[F,(t — nTs)] (5.20) 


n=— Co 


The DTFT interpolating formula (5.19) looks similar. 

However, there are some differences. First, the time-domain formula 
(5.20) reconstructs an arbitrary nonperiodic analog signal, while the 
frequency-domain formula (5.19) gives us a periodic waveform. Second, in 

sin( Nx) 
(5.19) we use a = 
sin (sinc) function. The ®(w) function is a periodic function and hence 
is known as a periodic-sinc function. It is also known as the Dirichlet 
function. This is the function we observed in Example 5.2. 


interpolation function instead of our more familiar 


5.2.3 MATLAB IMPLEMENTATION 

The interpolation formula (5.19) suffers the same fate as that of (5.20) 
while trying to implement it in practice. One has to generate several inter- 
polating functions (5.18) and perform their linear combinations to obtain 
the discrete-time Fourier transform X(e/”) from its computed samples 
X (k). Furthermore, in MATLAB we have to evaluate (5.19) on a finer grid 
over 0 < w < 2r. This is clearly an inefficient approach. Another approach 
is to use the cubic spline interpolation function as an efficient approxi- 
mation to (5.19). This is what we did to implement (5.20) in Chapter 3. 
However, there is an alternate and efficient approach based on the DFT, 
which we will study in the next section. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 


Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


154 Chapter 5 m THE DISCRETE FOURIER TRANSFORM 


5.3 THE DISCRETE FOURIER TRANSFORM 
—— gp 


The discrete Fourier series provides a mechanism for numerically comput- 
ing the discrete-time Fourier transform. It also alerted us to a potential 
problem of aliasing in the time domain. Mathematics dictates that the 
sampling of the discrete-time Fourier transform result in a periodic se- 
quence %(n). But most of the signals in practice are not periodic. They 
are likely to be of finite duration. How can we develop a numerically com- 
putable Fourier representation for such signals? Theoretically, we can take 
care of this problem by defining a periodic signal whose primary shape is 
that of the finite-duration signal and then using the DFS on this periodic 
signal. Practically, we define a new transform called the discrete Fourier 
transform (DFT), which is the primary period of the DFS. This DFT 
is the ultimate numerically computable Fourier transform for arbitrary 
finite-duration sequences. 

First we define a finite-duration sequence x(n) that has N samples 
over 0 < n < N —1 as an N-point sequence. Let £(n) be a periodic signal 
of period N, created using the N-point sequence x(n); that is, from (5.19) 


Co 


&(n) = 5 s(n- rN) 


r=— oo 


This is a somewhat cumbersome representation. Using the modulo-N 
operation on the argument we can simplify it to 


Z(n) = x(n mod N) (5.21) 


A simple way to interpret this operation is the following: if the argument 
n is between 0 and N — 1, then leave it as it is; otherwise add or sub- 
tract multiples of N from n until the result is between 0 and N — 1. Note 
carefully that (5.21) is valid only if the length of x(n) is N or less. Further- 
more, we use the following convenient notation to denote the modulo-N 
operation. 


x((n))n & z(nmod N) (5.22) 


Then the compact relationships between x(n) and Z(n) are 


ž(n)= UN (Periodic extension) (5.23) 
x(n) = &(n)Rn(n) (Window operation) 


The rem(n,N) function in MATLAB determines the remainder after di- 
viding n by N. This function can be used to implement our modulo-N 
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operation when n > 0. When n < 0, we need to modify the result to 
obtain correct values. This is shown below in the m=mod(n,N) function. 


function m = mod(n,N) 

% Computes m = (n mod N) index 
openness Se See Bee eee 

= mod(n,N) 

rem(n,N); m = m+N; m = rem(m,N); 


x 
i) 


In this function n can be any integer array, and the array m contains the 
corresponding modulo-N values. 

From the frequency sampling theorem we conclude that N equispaced 
samples of the discrete-time Fourier transform X(e?”) of the N-point se- 
quence a(n) can uniquely reconstruct X(e/”). These N samples around 
the unit circle are called the discrete Fourier transform coefficients. Let 
X(k) = DFS (n), which is a periodic (and hence of infinite duration) 
sequence. Its primary interval then is the discrete Fourier transform, 
which is of finite duration. These notions are made clear in the follow- 
ing definitions. The Discrete Fourier Transform of an N-point sequence is 


given by 
X(k), 0<k<N-1 > 
X(k) SDFT[x(ny] AEN E RR 
0, elsewhere 
or 
N-1 
X(k) = So a(n)WHY, O<k<N-1 (5.24) 
n=0 


Note that the DFT X(k) is also an N-point sequence, that is, it is 
not defined outside of 0 < k < N — 1. From (5.23) X(k) = X((k))y; 
that is, outside the 0 < k < N — 1 interval only the DFS X(k) is de- 
fined, which of course is the periodic extension of X(k). Finally, X(k) = 
X(k)Rn(k) means that the DFT X(k) is the primary interval of X (k). 
The inverse discrete Fourier transform of an N-point DFT X(k) is 


given by 
a(n) Ê IDFT [X(k)] = &(n)Rn(n) 
or 
1 N-1 
a(n) = a X(W, O<n<N-1 (5.25) 
k=0 


Once again x(n) is not defined outside 0 < n < N — 1. The extension of 
x(n) outside this range is &(n). 
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5.3.1 MATLAB IMPLEMENTATION 

It is clear from the discussions at the top of this section that the DFS is 
practically equivalent to the DFT when 0 < n < N — 1. Therefore the 
implementation of the DFT can be done in a similar fashion. If x(n) and 
X(k) are arranged as column vectors x and X, respectively, then from 
(5.24) and (5.25) we have 


X = WŴynx 
1 (5.26) 
x=; W}X 


where Wy is the matrix defined in (5.7) and will now be called a DFT 
matrix. Hence the earlier dfs and idfs MATLAB functions can be re- 
named as the dft and idft functions to implement the discrete Fourier 
transform computations. 


function [Xk] = dft(xn,N) 

% Computes Discrete Fourier Transform 

Sige SESE rn ete eye se en eae 

%, [Xk] = dft(xn,N) 

% Xk = DFT coeff. array over 0 <= k <= N-1 
% xn = N-point finite-duration sequence 

% N = Length of DFT 


h 

n = [(0:1:N-1]; % row vector for n 

k = [0:1:N-1]; % row vecor for k 

WN = exp(-j*2*pi/N) ; % Wn factor 

nk = n’*k; % creates a N by N matrix of nk values 
WNnk = WN .^ nk; %, DFT matrix 

Xk = xn * WNnk; % row vector for DFT coefficients 


function [xn] = idft(Xk,N) 

% Computes Inverse Discrete Transform 

i a 

% [xn] = idft(Xk,N) 

% xn = N-point sequence over 0 <= n <= N-1 
% Xk = DFT coeff. array over 0 <= k <= N-1 


% N = length of DFT 

% 

n = [0:1:N-1]; % row vector for n 

k = [0:1:N-1]; %, row vecor for k 

WN = exp(-j*2*pi/N); % Wn factor 

nk = n’*k; % creates a N by N matrix of nk values 
WNnk = WN .^ (-nk); % IDFT matrix 


xn = (Xk * WNnk)/N; %, row vector for IDFT values 
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EXAMPLE 5.6 Let x(n) be a 4-point sequence: 


10<n<3 
a(n) = , 
0, otherwise 


a. Compute the discrete-time Fourier transform X(e’”) and plot its magni- 
tude and phase. 
b. Compute the 4-point DFT of x(n). 


Solution a. The discrete-time Fourier transform is given by 


3 
X(e!”) a Sema" — ipei” 4 e524 rgi 
0 


o 1l-e 7” sin(2w) eo 93u/2 
l—e-J¥  sin(w/2) 
Hence 
jo sin(2w) 
|x )| ~ | sin(w/2) 
and 
3 : 
©, wnn 282), g 
2 sin(w/2) 
LX(e?”) = 
3w Hat sin(2w) <0 
pe re sin(w/2) 


The plots are shown in Figure 5.4. 
b. Let us denote the 4-point DFT by X4 (k). Then 


3 
Xa(k) = S anw"; k=0,1,2,3; Wa = e/t = j 
n=0 


These calculations are similar to those in Example 5.1. We can also use 
MATLAB to compute this DFT. 


>> x = [1,1,1,1]; N = 4; X = dft(x,N); 
>> magX = abs(X), phaX = angle(X)*180/pi 


magX = 
4.0000 0.0000 0.0000 0.0000 
phax = 
O -134.9810 -90.0000 -44.9979 
Hence 


X4(k) = {4,0,0,0} 
T 


Note that when the magnitude sample is zero, the corresponding angle is not 
zero. This is due to a particular algorithm used by MATLAB to compute the 
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Magnitude of the DTFT 
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frequency in m units 


FIGURE 5.4 The DTFT plots in Example 5.6 


angle part. Generally these angles should be ignored. The plot of DFT values 
is shown in Figure 5.5. The plot of X(e%”) is also shown as a dashed line for 
comparison. From the plot in Figure 5.5 we observe that X4 correctly gives 
4 samples of X(e?”), but it has only one nonzero sample. Is this surprising? By 
looking at the 4-point x(n), which contains all 1’s, one must conclude that its 
periodic extension is 


&(n) =1, Vn 


which is a constant (or a DC) signal. This is what is predicted by the DFT 
X4(k), which has a nonzero sample at k = 0 (or w = 0) and has no values at 
other frequencies. 


EXAMPLE 5.7 How can we obtain other samples of the DTFT X (e°)? 


Solution It is clear that we should sample at dense (or finer) frequencies; that is, we 
should increase N. Suppose we take twice the number of points, or N = 8 
instead of 4. This we can achieve by treating x(n) as an 8-point sequence by 
appending 4 zeros. 


x(n) = {1, 1, 1, 1,0, 0, 0, 0} 
T 
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Magnitude of the DFT: N=4 
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FIGURE 5.5 The DFT plots of Example 5.6 


This is a very important operation called a zero-padding operation. This oper- 
ation is necessary in practice to obtain a dense spectrum of signals as we shall 
see. Let Xs (k) be an 8-point DFT, then 


iG 
Xs (k) =X awe k=0,1,...,7; Ws = e77 
n=0 


In this case the frequency resolution is wı = 27/8 = 7/4. 


MATLAB script: 


>> x = [1,1,1,1, zeros(1,4)]; N = 8; X = dft(x,N); 
>> magX = abs(X), phaX = angle(X)*180/pi 
magX = 
4.0000 2.6131 0.0000 1.0824 0.0000 1.0824 0.0000 2.6131 
phax = 
O -67.5000 -134.9810 -22.5000 -90.0000 22.5000 -44.9979 67.5000 


Hence 


Xs (k) = {4, 2,6131e 71875", 0, 1.0824¢7322-5° 0, 1.0824¢7225° 
T 


0, 2.6131e7°7> } 
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Magnitude of the DFT: N=8 
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FIGURE 5.6 The DFT plots of Example 5.7: N = 8 


which is shown in Figure 5.6. Continuing further, if we treat x(n) as a 16-point 
sequence by padding 12 zeros, such that 


a(n) = {1, 1, 1, 1,0,0, 0, 0,0, 0,0, 0,0, 0, 0, 0} 
T 


then the frequency resolution is wı = 27/16 = 7/8 and Wig = e 37/8 Therefore 
we get a more dense spectrum with spectral samples separated by 7/8. The 
sketch of X16 (k) is shown in Figure 5.7. 

It should be clear then that if we obtain many more spectral samples by 
choosing a large N value then the resulting DFT samples will be very close to 
each other and we will obtain plot values similar to those in Figure 5.4. However, 
the displayed stem-plots will be dense. In this situation a better approach to 
display samples is to either show them using dots or join the sample values using 
the plot command (that is, using the FOH studied in Chapter 3). Figure 5.8 
shows the magnitude and phase of the 128-point DFT 2x128(k) obtained by 
padding 120 zeros. The DFT magnitude plot overlaps the DTFT magnitude plot 
shown as dotted-line while the phase plot shows discrepancy at discontinuities 
due to finite N value, which should be expected. 


Comments: Based on the last two examples there are several comments 
that we can make. 
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Magnitude of the DFT: N=16 
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FIGURE 5.7 The DFT plots of Example 5.7: N = 16 


1. Zero-padding is an operation in which more zeros are appended to the 
original sequence. The resulting longer DFT provides closely spaced 
samples of the discrete-time Fourier transform of the original sequence. 
In MATLAB zero-padding is implemented using the zeros function. 


2. In Example 5.6 all we needed to accurately plot the discrete-time 
Fourier transform X(ef”) of x(n) was X4 (k), the 4-point DFT. This 
is because z(n) had only 4 nonzero samples, so we could have used the 
interpolation formula (5.19) on X4 (k) to obtain X(e%”). However, in 
practice, it is easier to obtain Xs (k) and X16 (k), and so on, to fill in 
the values of X(e/”) rather than using the interpolation formula. This 
approach can be made even more efficient using fast Fourier transform 
algorithms to compute the DFT. 

3. The zero-padding gives us a high-density spectrum and provides a better 
displayed version for plotting. But it does not give us a high-resolution 
spectrum because no new information is added to the signal; only ad- 
ditional zeros are added in the data. 


4. To get a high-resolution spectrum, one has to obtain more data from 
the experiment or observations (see Example 5.8 below). There are 
also other advanced methods that use additional side information or 
nonlinear techniques. 
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Magnitude of the DFT: N=128 
5 T T T T T 
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FIGURE 5.8 The DFT plots of Example 5.7 for N = 128 are shown as line 
plots 


EXAMPLE 5.8 ‘To illustrate the difference between the high-density spectrum and the 
high-resolution spectrum, consider the sequence 


x(n) = cos (0.4877) + cos (0.527n) 
We want to determine its spectrum based on the finite number of samples. 


a. Determine and plot the discrete-time Fourier transform of x(n), 0 < n < 10. 
b. Determine and plot the discrete-time Fourier transform of z(n), 
O<n< 100. 


Solution We could determine analytically the discrete-time Fourier transform in each 
case, but MATLAB is a good vehicle to study these problems. 


a. We can first determine the 10-point DFT of x(n) to obtain an estimate of its 
discrete-time Fourier transform. 
MATLAB Script: 


>> n = [0:1:99]; x = cos(0.48*pixn)+cos(0.52*pixn) ; 
>> ni = [0:1:9] ;y1 = x(1:1:10); 
>> subplot(2,1,1) ;stem(ni,y1); title(’signal x(n), 0 <= n <= 9’);xlabel(’n’) 
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signal x(n), 0 <= n <= 9 
T T T 
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FIGURE 5.9 Signal and its spectrum in Example 5.8a: N = 10 


>> Y1 = dft(y1,10); magY1 = abs(Y1(1:1:6)); 

>> k1 = 0:1:5 ;w1 = 2*pi/10*k1; 

>> subplot (2,1,2);stem(wi/pi,magY1);title(’Samples of DTFT Magnitude’); 
>> xlabel(’frequency in pi units’) 


The plots in Figure 5.9 show there aren’t enough samples to draw any conclu- 
sions. Therefore we will pad 90 zeros to obtain a dense spectrum. As explained 
in Example 5.7, this spectrum is plotted using the plot command. 


MATLAB Script: 


>> n2 = [0:1:99]; y2 = [x(1:1:10) zeros(1,90)]; 

>> subplot(2,1,1) ;stem(n2,y2) ;title(’signal x(n), 0 <= n <= 9 + 90 zeros’); 
>> xlabel(’n’) 

>> Y2 =dft (y2, 100) ; magY2 = abs (Y2(1:1:51)); 

>> k2 = 0:1:50; w2 = 2*pi/100*k2; 

>> subplot (2,1,2); plot(w3/pi,magY3); title(’DTFT Magnitude’); 

>> xlabel(’frequency in pi units’) 


Now the plot in Figure 5.10 shows that the sequence has a dominant frequency 
at w = 0.57. This fact is not supported by the original sequence, which has two 
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signal x(n), 0 <= n <= 9 + 90 zeros 
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FIGURE 5.10 Signal and its spectrum in Example 5.8a: N = 100 


frequencies. The zero-padding provided a smoother version of the spectrum in 
Figure 5.9. 


b. To get better spectral information, we will take the first 100 samples of x(n) 
and determine its discrete-time Fourier transform. 


MATLAB Script: 


>> subplot(2,1,1); stem(n,x); 

>> title(’signal x(n), 0 <= n <= 99’); xlabel(’n’) 

>> X = dft(x,100); magX = abs(X(1:1:51)); 

>> k = 0:1:50; w = 2*pi/100*k; 

>> subplot(2,1,2); plot(w/pi,magX); title(’DTFT Magnitude’); 
>> xlabel(’frequency in pi units’) 


Now the discrete-time Fourier transform plot in Figure 5.11 clearly shows two 
frequencies, which are very close to each other. This is the high-resolution spec- 
trum of x(n). Note that padding more zeros to the 100-point sequence will result 
in a smoother rendition of the spectrum in Figure 5.11 but will not reveal any 
new information. Readers are encouraged to verify this. 
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signal x(n), 0 <= n <= 99 
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FIGURE 5.11 Signal and its spectrum in Example 5.8b: N = 100 


5.4 PROPERTIES OF THE DISCRETE FOURIER TRANSFORM 
—— gp 


The DFT properties are derived from those of the DFS because mathe- 
matically DFS is the valid representation. We discuss several useful prop- 
erties, which are given without proof. These properties also apply to the 
DFS with necessary changes. Let X (k) be an N-point DFT of the se- 
quence x(n). Unless otherwise stated, the N-point DFTs will be used in 
these properties. 


1. Linearity: The DFT is a linear transform 
DFT [axı (n) + bx2(n)] = a DFT [x1 (n)] + b DFT [x2(n)] (5.27) 


Note: If x(n) and x2(n) have different durations—that is, they are 
N-point and N2-point sequences, respectively—then choose N3 = 
max(N 1, N2) and proceed by taking N3-point DFTs. 

2. Circular folding: If an N-point sequence is folded, then the result 
xz(—n) would not be an N-point sequence, and it would not be possible 
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to compute its DFT. Therefore we use the modulo-N operation on the 
argument (—n) and define folding by 


x(0), n=0 
x (( eee (5.28) 
This is called a circular folding. To visualize it, imagine that the se- 
quence x(n) is wrapped around a circle in the counterclockwise direc- 
tion so that indices n = 0 and n = N overlap. Then x((—n))y can be 
viewed as a clockwise wrapping of x(n) around the circle; hence the 
name circular folding. In MATLAB the circular folding can be achieved 
by x=x(mod(-n,N)+1). Note that the arguments in MATLAB begin 
with 1. The DFT of a circular folding is given by 


X(0), k=0 


5.29 
X(N-k),1<k<N-1 ae 


DFT [e ((-n))y] = X ((-A)) y= 


EXAMPLE 5.9 Let x(n) = 10(0.8)", O<n< 10. 


a. Determine and plot x ((—n)),,. 
b. Verify the circular folding property. 


Solution a. MATLAB script: 


>> n = 0:100; x = 10*(0.8) .^ n; y = x(mod(-n,11)+1); 

>> subplot(2,1,1); stem(n,x); title(’Original sequence’) 

>> xlabel(’n’); ylabel(’x(n)’); 

>> subplot(2,1,2); stem(n,y); title(’Circularly folded sequence’) 
>> xlabel(’n’); ylabel(’x(-n mod 10)’); 


The plots in Figure 5.12 show the effect of circular folding. 
b. MATLAB script: 


>> X = dft(x,11); Y= dft(y,11); 

>> subplot(2,2,1); stem(n,real(X)); 

>> title(’Real{DFT[x(n)]}’); xlabel(’k’); 

>> subplot(2,2,2); stem(n,imag(X)); 

>> title(’Imag{DFT[x(n)]}’); xlabel(’k’); 

>> subplot(2,2,3); stem(n,real(Y)); 

>> title(’Real{DFT[x((-n))11]}’); xlabel(’k’); 
>> subplot(2,2,4); stem(n,imag(Y)) ; 

>> title(’ Imag{DFT[x((-n))11]}’); xlabel(’k’); 


The plots in Figure 5.13 verify the property. 
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FIGURE 5.12 Circular folding in Example 5.9a 
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FIGURE 5.13 Circular folding property in Example 5.9b 
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3. Conjugation: Similar to the above property we have to introduce the 
circular folding in the frequency domain. 


DFT [2*(n)] = X* ((-k))y (5.30) 


4. Symmetry properties for real sequences: Let x(n) be a real- 
valued N-point sequence. Then x(n) = z* (n). Using (5.30) 


XH (5.31) 
This symmetry is called a circular conjugate symmetry. It further im- 
plies that 

Re [X(k)] = Re [X ((—k)) x] = > Circular-even sequence 
Im [X(k)] = — Im [X ((N — k)) vy] => Circular-odd sequence 
|X(k)| = |X ((—k)) y| => Circular-even sequence 
L£X(k) =—2X ((-k))y = > Circular-odd sequence 
(5.32) 
Comments: 


1. Observe the magnitudes and angles of the various DFTs in Examples 
5.6 and 5.7. They do satisfy the above circular symmetries. These sym- 
metries are different than the usual even and odd symmetries. To visu- 
alize this, imagine that the DFT samples are arranged around a circle 
so that the indices k = 0 and k = N overlap; then the samples will 
be symmetric with respect to k = 0, which justifies the name circular 
symmetry. 

2. The corresponding symmetry for the DFS coefficients is called the pe- 
riodic conjugate symmetry. 


3. Since these DFTs have symmetry, one needs to compute X(k) only for 


k=0,1,...,—; N even 


or for 
k=0,1,..., i N odd 


This results in about 50% savings in computation as well as in storage. 
4. From (5.30) 
X(0) = X*((—0)) nw = X*(0) 
which means that the DFT coefficient at k = 0 must be a real number. 
But k = 0 means that the frequency wk = kw, = 0, which is the DC 
frequency. Hence the DC coefficient for a real-valued x(n) must be a 
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real number. In addition, if N is even, then N/2 is also an integer. 
Then from (5.32) 


X (N/2) = X* ((—N/2))y = X* (N/2) 


which means that even the k = N/2 component is also real-valued. 
This component is called the Nyquist component since k = N/2 means 
that the frequency wy/2 = (N/2)(21/N) = m, which is the digital 
Nyquist frequency. 


The real-valued signals can also be decomposed into their even and odd 
components, xe(n) and x, (n), respectively, as discussed in Chapter 2. 
However, these components are not N-point sequences and therefore we 
cannot take their N-point DFTs. Hence we define a new set of components 
using the circular folding discussed above. These are called circular-even 
and circular-odd components defined by 


he 7 x(0), n=0 
Lec (n) = 5 (x(n) +z ((—n)) y] = aer l<n<N-I1 
ne 7 0, n=0 
Toc (n) = 5 [z(n) — z ((—n)) ny] = T E ee l<n<N-I1 
(5.33) 
Then 
DFT [vec (n)] = Re [X(k)] = Re [X ((—k))y] (5.34) 


DFT [zoe (n)] = Im [X(k)] = Im [X ((—k)) y] 


Implication: If x(n) is real and circular-even, then its DFT is also real 
and circular-even. Hence only the first 0 < n < N/2 coefficients are 
necessary for complete representation. 

Using (5.33), it is easy to develop a function to decompose an N-point 
sequence into its circular-even and circular-odd components. The follow- 
ing circevod function uses the mod function given earlier to implement 
the modulo-N operation. 


function [xec, xoc] = circevod(x) 
% signal decomposition into circular-even and circular-odd parts 


% [xec, xoc] = circevod(x) 
% 
if any(imag(x) ~= 0) 
error(’x is not a real sequence’) 
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end 
N = length(x); n = 0:(N-1); 
xec = 0.5*(x + x(mod(-n,N)+1)); xoc = 0.5*(x - x(mod(-n,N)+1)); 


EXAMPLE 5.10 Let x(n) = 10 (0.8)”, 0< n < 10 as in Example 5.9. 


a. Decompose and plot the zec(n) and roc(n) components of x(n). 
b. Verify the property in (5.34). 


Solution a. MATLAB script: 


>> n = 0:10; x = 10*(0.8) .^ n; 

>> [xec,xoc] = circevod(x); 

>> subplot(2,1,1); stem(n,xec); title(’Circular-even component’) 
>> xlabel(’n’); ylabel(’xec(n)’); axis([-0.5,10.5,-1,11]) 

>> subplot(2,1,2); stem(n,xoc); title(’Circular-odd component’ ) 
>> xlabel(’n’); ylabel(’xoc(n)’); axis([-0.5,10.5,-4,4]) 


The plots in Figure 5.14 show the circularly symmetric components of x(n). 
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FIGURE 5.14 Circular-even and circular-odd components of the sequence in 
Example 5.10a 
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FIGURE 5.15 Plots of DFT symmetry properties in Example 5.10b 


b. MATLAB script: 


>> X = dft(x,11); Xec = dft(xec,11); Xoc = dft(xoc,11); 

>> subplot(2,2,1); stem(n,real(X)); axis([-0.5,10.5,-5,50]) 
>> title(’Real{DFT[x(n)]}’); xlabel(’k’); 

>> subplot (2,2,2); stem(n,imag(X)); axis([-0.5,10.5,-20,20]) 
>> title(’Imag{DFT[x(n)]}’); xlabel(’k’); 

>> subplot (2,2,3); stem(n,real(Xec)); axis([-0.5,10.5,-5,50]) 
>> title(’DFT[xec(n)]’); xlabel(’k’); 

>> subplot(2,2,4); stem(n,imag(Xoc)); axis([-0.5,10.5,-20,20]) 
>> title(’DFT[xoc(n)]’); xlabel(’k’); 


From the plots in Figure 5.15 we observe that the DFT of xrec(n) is the same as 
the real part of X (k) and that the DFT of zoc(n) is the same as the imaginary 
part of X(k). 


A similar property for complex-valued sequences is explored in Prob- 
lem P5.18. 


5. Circular shift of a sequence: If an N-point sequence is shifted in 
either direction, then the result is no longer between 0 <n < N —1. 
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Therefore we first convert x(n) into its periodic extension (n), and 
then shift it by m samples to obtain 


&(n—-—m)=a((n—m))yx (5.35) 


This is called a periodic shift of (n). The periodic shift is then con- 
verted into an N-point sequence. The resulting sequence 


t(n—m)Rn(n) = 2 ((n — m)) y Rn (n) (5.36) 


is called the circular shift of x(n). Once again to visualize this, imagine 
that the sequence x(n) is wrapped around a circle. Now rotate the circle 
by k samples and unwrap the sequence from 0 < n < N — 1. Its DFT 
is given by 


DFT [æ ((n — m)) vy Rw(n)] = W” X (k) (5.37) 


EXAMPLE 5.11 Let x(n) = 10(0.8)", 0< n < 10 be an 11-point sequence. 


a. Sketch z((n + 4))i1.Rii(n), that is, a circular shift by 4 samples toward the 
left. 

b. Sketch x((n — 3))ıs Rıs (n), that is, a circular shift by 3 samples toward the 
right, where x(n) is assumed to be a 15-point sequence. 


Solution We will use a step-by-step graphical approach to illustrate the circular shifting 
operation. This approach shows the periodic extension £(n) = x((n))n of x(n), 
followed by a linear shift in Z(n) to obtain ¢(n — m) = x((n—m))w, and finally 
truncating Z(n — m) to obtain the circular shift. 


a. Figure 5.16 shows four sequences. The top-left shows x(n), the bottom-left 
shows (n), the top-right shows (n +4), and finally the bottom-right shows 
x((n+4))11Ri1(n). Note carefully that as samples move out of the [0, N — 1] 
window in one direction, they reappear from the opposite direction. This is 
the meaning of the circular shift, and it is different from the linear shift. 


b. In this case the sequence x(n) is treated as a 15-point sequence by padding 
4 zeros. Now the circular shift will be different than when N = 11. This 
is shown in Figure 5.17. In fact the circular shift x ((n — 3)),, looks like a 
linear shift x(n — 3). 


To implement a circular shift, we do not have to go through the 
periodic shift as shown in Example 5.11. It can be implemented directly 
in two ways. In the first approach, the modulo-N operation can be used 
on the argument (n — m) in the time domain. This is shown below in the 
cirshftt function. 
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FIGURE 5.16 Graphical interpretation of circular shift, N = 11 
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FIGURE 5.17 Graphical interpretation of circular shift, N = 15 
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function y = cirshftt(x,m,N) 

% Circular shift of m samples wrt size N in sequence x: (time domain) 

a a Ee ee 

% [y] = cirshftt (x,m,N) 

% y = output sequence containing the circular shift 

% x = input sequence of length <= N 
m 
N 


` 


% m = sample shift 
% N = size of circular buffer 
% Method: y(n) = x((n-m) mod N) 
% Check for length of x 
if length(x) > N 
error(’N must be >= the length of x’) 


> 


end 
x = [x zeros(1,N-length(x))]; 
n [0:1:N-1]; n = mod(n-m,N); y = x(n+1); 


In the second approach, the property (5.37) can be used in the frequency 
domain. This is explored in Problem P5.20. 


EXAMPLE 5.12 Given an 11-point sequence x(n) = 10(0.8)", 0< n < 10, determine and plot 
x((n—6)),5. 


Solution MATLAB script: 


>> n = 0:10; x 10*(0.8) .^ n; y = cirshftt(x,6,15); 
>> n = 0:14; x = [x, zeros(1,4)]; 

>> subplot(2,1,1); stem(n,x); title(’Original sequence’) 
>> xlabel(’n’); ylabel(’x(n)’); 

>> subplot(2,1,2); stem(n,y); 

>> title(’Circularly shifted sequence, N=15’) 

>> xlabel(’n’); ylabel(’x((n-6) mod 15)’); 


The results are shown in Figure 5.18. 


6. Circular shift in the frequency domain: This property is a dual 
of the preceding property given by 


DFT [Wy"2(n)] = X ((k — £) y Rn (k) (5.38) 


7. Circular convolution: A linear convolution between two N-point 
sequences will result in a longer sequence. Once again we have to 
restrict our interval to 0 < n < N — 1. Therefore instead of linear 
shift, we should consider the circular shift. A convolution operation 
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FIGURE 5.18 Circularly shifted sequence in Example 5.12 


that contains a circular shift is called the circular convolution and is 
given by 


x(n) N) a(n) = X` ai(m)x2((n—m))y, O<n<N-1 (5.39) 


m=0 


Note that the circular convolution is also an N-point sequence. It has 
a structure similar to that of a linear convolution. The differences 
are in the summation limits and in the N-point circular shift. Hence 
it depends on N and is also called_an N-point circular convolution. 
Therefore the use of the notation O) is appropriate. The DFT prop- 
erty for the circular convolution is 


DFT [eu(n) D) w2(n)| = Xi (k) - Xo(k) (5.40) 
An alternate interpretation of this property is that when we multi- 


ply two N-point DFTs in the frequency domain, we get the circular 
convolution (and not the usual linear convolution) in the time domain. 


EXAMPLE 5.13 Let zı(n) = {1,2,2} and x2(n) = {1,2,3,4}. Compute the 4-point circular 


convolution zı (n) zə(n). 
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Solution Note that xi(n) is a 3-point sequence, hence we will have to pad one zero to 
make it a 4-point sequence before we perform the circular convolution. We will 
compute this convolution in the time domain as well as in the frequency domain. 
In the time domain we will use the mechanism of circular convolution, while in 
the frequency domain we will use the DFTs. 


e Time-domain approach: The 4-point circular convolution is given by 


3 
w1(n) (4) z2(n) = Sa (m) z2 ((n—m)), 
m=0 
Thus we have to create a circularly folded and shifted sequence x2((n—™m))Nn 
for each value of n, multiply it sample by sample with zı (m), add the samples 
to obtain the circular convolution value for that n, and then repeat the 
procedure for 0 < n < 3. Consider 


x1(m) = {1, 2, 2, 0} and x2(m) = {1, 2, 3, 4} 


for n= 0 


3 


SS HL 2, 2, 0} {1, 4, 3, 2}] 


3 
do za (m) -x2 ((0- m)); 


=0 m=0 
3 
= Ň_{1, 8, 6, 0}=15 
m=0 
for n= 1 
3 3 
XO am) z ((-m)), = X. H1, 2, 2, 0}- {2, 1, 4, 3} 
m=0 m=0 
3 
= $2 (2, 2, 8, 0}=12 
m=0 
forn = 2 
3 3 
XO n(m) z2 ((2-m))s = X. H1, 2, 2, OF- {3, 2, 1, 4} 
m=0 m=0 
3 
= S> {3, 4, 2, 0} =9 
m=0 
forn =3 
3 3 
XO vi(m)- a2 ((3-m))s = X. H1, 2, 2, OF- {4, 3, 2, 1} 
m=0 m=0 
3 
= >> {4, 6, 4, O}=14 
m=0 
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Hence 


x1(n) (4) ao(n) = {15, 12, 9, 14} 


e Frequency-domain approach: In this approach we first compute 4-point DFTs 
of x1(n) and x2(n), multiply them sample by sample, and then take the 
inverse DFT of the result to obtain the circular convolution. 


DFT of x1(n) 


x1(n) = {1, 2, 2,0} Xi(k) = {5, —1 — 72, 1, —1 + j2} 
DFT of x2(n) 


ae(n) = {1,2,3,4} => Xo(k) = {10, —2 + j2, —2, —2 — j2} 
Now 
Xi (k) - X2(k) = {50, 6 + j2, —2, 6 — j2} 
Finally after IDFT, 
zı(n) (4) z2(n) = {15, 12, 9, 14} 


which is the same as before. 


Similar to the circular shift implementation, we can implement the 
circular convolution in a number of different ways. The simplest approach 
would be to implement (5.39) literally by using the cirshftt function 
and requiring two nested for. ..end loops. Obviously, this is not efficient. 
Another approach is to generate a sequence z ((n — m))y for each n in 
[0, N — 1] as rows of a matrix and then implement (5.39) as a matrix- 
vector multiplication similar to our dft function. This would require 
one for...end loop. The following circonvt function incorporates these 
steps. 


function y = circonvt(x1,x2,N) 
% N-point circular convolution between x1 and x2: (time-domain) 


% [y] = circonvt(x1,x2,N) 
% y = output sequence containing the circular convolution 
% x1 = input sequence of length N1 <= N 
% x2 = input sequence of length N2 <= N 
% N = size of circular buffer 
% Method: y(n) = sum (x1(m)*x2((n-m) mod N)) 
% Check for length of x1 
if length(x1) > N 
error(’N must be >= the length of x1’) 
end 
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% Check for length of x2 
if length(x2) > N 
error(’N must be >= the length of x2’) 
end 
x1=[x1 zeros(1,N-length(x1))]; 
x2=[x2 zeros(1,N-length(x2))]; 
m = [0:1:N-1]; x2 = x2(mod(-m,N)+1); H = zeros(N,N); 
for n = 1:1:N 
H(m,:) = cirshftt(x2,n-1,N); 
end 
y = x1*conj(H’); 


Problems P5.24 and P5.25 explore an approach to eliminate the for... 
end loop in the circonvt function. The third approach would be to im- 
plement the frequency-domain operation (5.40) using the dft function. 
This is explored in Problem P5.26. 


EXAMPLE 5.14 Let us use MATLAB to perform the circular convolution in Example 5.13. 


Solution The sequences are xı (n) = {1, 2,2} and x2(n) = {1, 2,3, 4}. 
MATLAB script: 


>> x1 = [1,2,2]; x2 = [1,2,3,4]; y = circonvt(x1, x2, 4) 


y= 
15 12 9 14 
Hence 
x1(n) (4) wo(n) = {15, 12, 9, 14} 
as before. 


EXAMPLE 5.15 In this example we will study the effect of N on the circular convolution. Obvi- 
ously, N > 4; otherwise there will be a time-domain aliasing for 72(n). We will 
use the same two sequences from Example 5.13. 


a. Compute 21(n) G) x2(n). 
b. Compute zı(n) C6) za(n). 
c. Comment on the results. 


Solution The sequences are xı(n) = {1,2,2} and x2(n) = {1,2,3,4}. Even though the 
sequences are the same as in Example 5.14, we should expect different results 
for different values of N. This is not the case with the linear convolution, which 
is unique, given two sequences. 
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a. MATLAB Script for 5-point circular convolution: 


>> x1 = [1,2,2]; x2 = [1,2,3,4]; y = circonvt(x1, x2, 5) 


9 4 9 14 14 


x(n) (5) ao(n) = {9, 4, 9, 14, 14} 


b. MATLAB Script for 6-point circular convolution: 


>> x1 = [1,2,2]; x2 = [1,2,3,4]; y = circonvt(x1, x2, 6) 


1 4 9 14 14 8 


xi(n) ©) ao(n) = {1, 4, 9, 14, 14, 8} 


c. A careful observation of 4-, 5-, and 6-point circular convolutions from 
this and the previous example indicates some unique features. Clearly, an 
N-point circular convolution is an N-point sequence. However, some sam- 
ples in these convolutions have the same values, while other values can be 
obtained as a sum of samples in other convolutions. For example, the first 
sample in the 5-point convolution is a sum of the first and the last samples 
of the 6-point convolution. The linear convolution between #1(n) and x2(n) 
is given by 


x1(n) * v2(n) = {1, 4, 9, 14, 14, 8} 


which is equivalent to the 6-point circular convolution. These and other 
issues are explored in the next section. 


8. Multiplication: This is the dual of the circular convolution property. 
It is given by 


DFT [21 (n) -22(n)] = $ Xa (k) @ Xolk) (5.41) 


in which the circular convolution is performed in the frequency domain. 
The MATLAB functions developed for circular convolution can also be 
used here since Xj (k) and Xə (k) are also N-point sequences. 


9. Parseval’s relation: This relation computes the energy in the fre- 
quency domain. 


N-1 1 N-1 
E: = Ù [oP == D X (5.42) 
n=0 k=0 
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The quantity eGo" is called the energy spectrum of finite- ur ion se- 


quences. Similan, for periodic sequences, the quantity %2; is called 
the power spectrum. 


5.5 LINEAR CONVOLUTION USING THE DFT 
SEE Ee ee 


One of the most important operations in linear systems is the linear convo- 
lution. In fact, FIR filters are generally implemented in practice using this 
linear convolution. On the other hand, the DFT is a practical approach 
for implementing linear system operations in the frequency domain. As we 
shall see later, it is also an efficient operation in terms of computations. 
However, there is one problem. The DFT operations result in a circular 
convolution (something that we do not desire), not in a linear convolution 
that we want. Now we shall see how to use the DFT to perform a linear 
convolution (or equivalently, how to make a circular convolution identical 
to the linear convolution). We alluded to this problem in Example 5.15. 

Let xı(n) be an Nı-point sequence and let x2(n) be an No-point 
sequence. Define the linear convolution of x(n) and x(n) by x3(n), 
that is, 


43(n) = x(n) * x(n) 


foe) Ni-1 
= S© a(k)ao(n—k)= X` a(k)a2(n—k) (5.43) 
k=- 0 


Then gz3(n) is a (Nı + No — 1)-point sequence. If we choose N = 
max(Nı, N2) and compute an N-point circular convolution x(n) O) 
zə(n), then we get an N-point sequence, which obviously is different 
from 23(n). This observation also gives us a clue. Why not choose 
N = N, + N2 — 1 and perform an (N; + Nə — 1)-point circular con- 
volution? Then at least both of these convolutions will have an equal 
number of samples. 

Therefore let N = Nı + No — 1 and let us treat 21(n) and x2(n) as 
N-point sequences. Define the N-point circular convolution by x4(n). 


aa(n) = zi (n) X) z2(n) (5.44) 


N-1 
bs a4 (m)aa((n — ma Ry(n) 


m=0 


N-1 oo 
ps x1(m) 5 nn mr) Ryn(n) 
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| 


co Nı—1 


5 XO z(m)za(n=m-=rN) Ry(n) 


r=—co m=0 


z3(n—rN) 


Co 


=| X 23(n—rN)| Rn(n) using (5.43) 


T=—0o 


This analysis shows that, in general, the circular convolution is an aliased 
version of the linear convolution. We observed this fact in Example 5.15. 
Now since 73(n) is an N = (N; + No — 1)-point sequence, we have 


zan) =23(n); O<n<(N-1) 
which means that there is no aliasing in the time domain. 


Conclusion: If we make both x1(n) and x(n) N = Ny + No — 1 point 
sequences by padding an appropriate number of zeros, then the circular 
convolution is identical to the linear convolution. 


EXAMPLE 5.16 Let x1(m) and x2(n) be the following two 4-point sequences. 
xı(n) =, {1, 2, 2, 1}, x2(n) > {1, aly = 1} 


a. Determine their linear convolution x3(n). 
b. Compute the circular convolution x4(n) so that it is equal to x3(n). 


Solution We will use MATLAB to do this problem. 
a. MATLAB Script: 


>> x1 = [1,2,2,1]; x2 = [1,-1,-1,1]; x3 = conv(x1,x2) 
x3 = 1 1 = 4) =2 =A 1 1 


Hence the linear convolution x3(n) is a 7-point sequence given by 
r3(n) = {1, 1, =h —2, =l 1, 1} 


b.We will have to use N > 7. Choosing N = 7, we have 


>> x4 = circonvt(x1,x2,7) 
x4 = 1 1 = =2 a1 1 1 


Hence 
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5.5.1 ERROR ANALYSIS 

To use the DFT for linear convolution, we must choose N properly. How- 
ever, in practice it may not be possible to do so, especially when N is very 
large and there is a limit on memory. Then an error will be introduced 
when JN is chosen less than the required value to perform the circular 


convolution. We want to compute this error, which is useful in practice. 
Obviously, N > max(N1, N2). Therefore let 


max(Nı, N2) <N< (Ni + No - 1) 


Then, from our previous analysis (5.44) 


Let an error e(n) be given by 


I> 


e(n) 


zxa(n) — x3(n) 


S > xa(n —rN)| Ry(n) 


r#0 


Since N > max(Nj, N2), only two terms corresponding to r = +1 remain 
in the above summation. Hence 


e(n) = [a3(n — N) + 23(n + N)| Ru (n) 


Generally, xı (n) and zo(n) are causal sequences. Then x3(7) is also causal, 
which means that 


w3(n-N)=0; O<n<N-1 


Therefore 
e(n) = z3(n+ N), O<n<N-1 (5.45) 


This is a simple yet important relation. It implies that when 
max(Nı, No) < N < (Ni + N2 — 1) the error value at n is the same as the 
linear convolution value computed N samples away. Now the linear con- 
volution will be zero after (N1 + N2— 1) samples. This means that the first 
few samples of the circular convolution are in error, while the remaining 
ones are the correct linear convolution values. 


EXAMPLE 5.17 Consider the sequences xı(n) and z2(n) from the previous example. Evaluate 
circular convolutions for N = 6, 5, and 4. Verify the error relations in each case. 
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Solution Clearly, the linear convolution x3(n) is still the same. 
a3(n) = {1,1,-1,-2,-1,1,1} 
When N = 6, we obtain a 6-point sequence. 
za(n) = 21(n) © z2(n) = {2, 1, —1, -2, -1, 1} 


Therefore 


e(n) = {2,1,—1,—2,—1,1} — {1,1,-1,-2,-1,1}, 0<n<5 
= {1,0,0,0, 0,0} 
= 13(n + 6) 
as expected. When N = 5, we obtain a 5-point sequence, 


x4(n) = 21(n) © z2(n) = {2, 2, —1, -2, —1} 


and 


e(n) = {2,2,—1,—2,—1} — {1,1,—1,—2,—1}, 0<n<4 

= {1,1,0,0,0} 

= zz(n + 5) 
Finally, when N = 4, we obtain a 4-point sequence, 

za(n) = 21(n) (4) z2(n) = {0, 2,0, —2} 

and 

e(n) = {0,2,0,—2} — {1,1,—1,—2}, 0<n<3 
{—1,1,1,0} 
= z3(n + 4) 


The last case of N = 4 also provides the following useful observation. 


Observation: When N = max(Nj, N2) is chosen for circular convolution, then 
the first (M — 1) samples are in error (i.e., different from the linear convolution), 
where M = min(M1, N2). This result is useful in implementing long convolutions 
in the form of block processing. 


5.5.2 BLOCK CONVOLUTIONS 

When we want to filter an input sequence that is being received con- 
tinuously, such as a speech signal from a microphone, then for practical 
purposes we can think of this sequence as an infinite-length sequence. If 
we want to implement this filtering operation as an FIR filter in which 
the linear convolution is computed using the DFT, then we experience 
some practical problems. We will have to compute a large DFT, which is 
generally impractical. Furthermore, output samples are not available until 
all input samples are processed. This introduces an unacceptably large 
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amount of delay. Therefore we have to segment the infinite-length input 
sequence into smaller sections (or blocks), process each section using the 
DFT, and finally assemble the output sequence from the outputs of each 
section. This procedure is called a block convolution (or block processing) 
operation. 

Let us assume that the sequence x(n) is sectioned into N-point se- 
quences and that the impulse response of the filter is an M-point se- 
quence, where M < N. Then from the observation in Example 5.17 we 
note that the N-point circular convolution between the input block and 
the impulse response will yield a block output sequence in which the first 
(M — 1) samples are not the correct output values. If we simply partition 
x(n) into nonoverlapping sections, then the resulting output sequence will 
have intervals of incorrect samples. To correct this problem, we can parti- 
tion x(n) into sections, each overlapping with the previous one by exactly 
(M — 1) samples, save the last (N — M + 1) output samples, and finally 
concatenate these outputs into a sequence. To correct for the first (M — 1) 
samples in the first output block, we set the first (M — 1) samples in the 
first input block to zero. This procedure is called an overlap-save method 
of block convolutions. Clearly, when N >> M, this method is more effi- 
cient. We illustrate it using a simple example. 


EXAMPLE 5.18 Let a(n) =(n+1), O0<n< 9 and h(n) = {1,0,—1}. Implement the overlap- 
T 


save method using N = 6 to compute y(n) = a(n) * h(n). 


Solution Since M = 3, we will have to overlap each section with the previous one by two 
samples. Now x(n) is a 10-point sequence, and we will need (M — 1) = 2 zeros 
in the beginning. Since N = 6, we will need 3 sections. Let the sections be 


xi(n) = {0,0, 1,2,3,4} 
xo(n) = {3,4,5,6, 7, 8} 
x3(n) = {7,8,9, 10, 0,0} 
Note that we have to pad x3(n) by two zeros since x(n) runs out of values at 


n = 9. Now we will compute the 6-point circular convolution of each section 
with h(n). 


y = a1(n) ©) h(n) = {—3, —4, 1, 2,2, 2} 
y2 = zə(n) (6) h(n) = {—4, —4, 2, 2, 2, 2} 


ya = za(n) (6) h(n) = {7,8, 2,2, —9, —10} 
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Noting that the first two samples in each section are to be discarded, we assemble 
the output y(n) as 


y(n) = 4152525252; 2, 2, 2, 2, 2, —9, —10} 
i 


The linear convolution is given by 


a(n) * h(n) = {1, 2,2,2, 2, 2, 2,2, 2,2, —9, —10} 
T 


which agrees with the overlap-save method. 


5.5.3 MATLAB IMPLEMENTATION 

Using this example as a guide, we can develop a MATLAB function to 
implement the overlap-save method for a very long input sequence x(n). 
The key step in this function is to obtain a proper indexing for the 
segmentation. Given x(n) for n > 0, we have to set the first (M — 1) 
samples to zero to begin the block processing. Let this augmented se- 
quence be 


a(n) Ê {0,0,...,0,a(n)}, n>0 
< 
(M-—1) zeros 
and let L = N — M +1, then the kth block zg(n), O0<n<N-l1,is 
given by 
up(n)=&(m); kL<m<kL+N-1,k>0,0<n<N-1 


The total number of blocks is given by 


N. M-—2 
=| | +1 


where Ny is the length of x(n) and |-| is the truncation operation. Now 
each block can be circularly convolved with h(n) using the circonvt 
function developed earlier to obtain 


y(n) = xx(n) @) h(n) 


Finally, discarding the first (M — 1) samples from each y(n) and con- 
catenating the remaining samples, we obtain the linear convolution y(n). 
This procedure is incorporated in the following ovrlpsav function. 
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hh\leftskip12pt 
function [y] = ovrlpsav(x,h,N) 
% Overlap-Save method of block convolution 


% [y] = ovrlpsav(x,h,N) 
% y = output sequence 


% x = input sequence 
% h = impulse response 
% N = block length 

% 


Lenx = length(x); M = length(h); M1 = M-1; L = N-M1; 


h = [h zeros(1,N-M)]; 

ih 

x = [zeros(1,M1), x, zeros(1,N-1)]; % preappend (M-1) zeros 
K = floor((Lenx+M1-1)/(L)); i, # of blocks 

Y = zeros(K+1,N); 


% convolution with succesive blocks 
for k=0:K 

xk = x(k*L+1:k*L+N) ; 

Y(k+1,:) = circonvt(xk,h,N); 


end 
Y = Y(:,M:N)’; % discard the first (M-1) samples 
We = OMS)? 3 % assemble output 


Note: The ovrlpsav function as developed here is not the most efficient 
approach. We will come back to this issue when we discuss the fast Fourier 
transform. 


EXAMPLE 5.19 To verify the operation of the ovrlpsav function, let us consider the sequences 
given in Example 5.18. 


Solution MATLAB script: 


>> n = 0:9; x = ntl; h = [1,0,-1]; N= 6; y = ovrlpsav(x,h,N) 


y = 
1 2 2 2 2 2 2 2 2 2 =f) -10 


This is the correct linear convolution as expected. 


There is an alternate method called an overlap-add method of block 
convolutions. In this method the input sequence x(n) is partitioned into 
nonoverlapping blocks and convolved with the impulse response. The re- 
sulting output blocks are overlapped with the subsequent sections and 
added to form the overall output. This is explored in Problem P5.32. 
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5.6 THE FAST FOURIER TRANSFORM 
—— g 


The DFT (5.24) introduced earlier is the only transform that is discrete in 
both the time and the frequency domains, and is defined for finite-duration 
sequences. Although it is a computable transform, the straightforward 
implementation of (5.24) is very inefficient, especially when the sequence 
length N is large. In 1965 Cooley and Tukey [1] showed a procedure to 
substantially reduce the amount of computations involved in the DFT. 
This led to the explosion of applications of the DFT, including in the 
digital signal processing area. Furthermore, it also led to the development 
of other efficient algorithms. All these efficient algorithms are collectively 
known as fast Fourier transform (FFT) algorithms. 

Consider an N-point sequence x(n). Its N-point DFT is given by 
(5.24) and reproduced here 


N-1 
X(k) = So a(n)WH, OS RS N-1 (5.46) 
n=0 


where Wy = e~J?7/%. To obtain one sample of X(k), we need N complex 
multiplications and (N—1) complex additions. Hence to obtain a complete 
set of DFT coefficients, we need N? complex multiplications and N(N—1) 
œ~ N? complex additions. Also one has to store N? complex coefficients 
{WRF} (or generate internally at an extra cost). Clearly, the number of 
DFT computations for an N-point sequence depends quadratically on N, 
which will be denoted by the notation 


CN = o (N?) 


For large N, o (N 2) is unacceptable in practice. Generally, the pro- 
cessing time for one addition is much less than that for one multiplication. 
Hence from now on we will concentrate on the number of complex multi- 
plications, which itself requires 4 real multiplications and 2 real additions. 


Goal of an Efficient Computation In an efficiently designed algo- 
rithm the number of computations should be constant per data sample, 
and therefore the total number of computations should be linear with 
respect to N. 

The quadratic dependence on N can be reduced by realizing that most 
of the computations (which are done again and again) can be eliminated 
using the periodicity property 


win = nee = WhtN)n 
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EXAMPLE 5.20 


Solution 
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and the symmetry property 
Wer = —wkn 


of the factor 1 WP}. 

One algorithm that considers only the periodicity of WR* is the 
Goertzel algorithm. This algorithm still requires Cy = o(N?) multi- 
plications, but it has certain advantages. This algorithm is described in 
Chapter 12. We first begin with an example to illustrate the advantages of 
the symmetry and periodicity properties in reducing the number of com- 
putations. We then describe and analyze two specific FFT algorithms that 
require Cy = o(N log N) operations. They are the decimation-in-time 
(DIT-FFT) and decimation-in-frequency (DIF-FFT) algorithms. 


Let us discuss the computations of a 4-point DFT and develop an efficient 
algorithm for its computation. 


X(k)= So a(n)we', OS k<3; Wise t= -j 


n=0 


These computations can be done in the matrix form 


X(0) w? W} W} W9] prz(0) 
X(1) Wr Wi Wi W3 | |z(1) 
X| |w? w2 wé w| |22) 
X(3) w} w3 W$ Wed La(3) 


which requires 16 complex multiplications. 


Efficient Approach Using periodicity, 


We =Wi =1 
Wi = Wî = 


; Wi = We = -j 
1;Wi=j 


and substituting in the above matrix form, we get 


‘X (0) 1 1 1 1J fæz(0) 
X)| Jl -7 -1 j| |20) 
X(2)| J1 -1) 1-1} |z(2) 
X (3) 1 7-1 =j] Le(3) 
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Using symmetry, we obtain 


X(0) = x(0)+2(1) + 2(2) + 2(3) = [x(0) + 2(2)] + [x(1) + x(3)] 


X(2)= «(0)—2(1) + 2(2) —2(3) = [x(0) + x(2)] — [x(1) + (3) ] 
—$ —$ 
X(3) = #(0) + ja(1) — z(2) — jx(3) = [æ(0) — x(2)] +5[@Q) — z(3)] 
— — 
Hence an efficient algorithm is 
Step 1 Step 2 
gı = x(0) + x(2) X(0) = gı +92 
g2 = x(1) + x(3) X (1) = hi — jhe (5.47) 
hı = x(0) — x(2) X(2)= gı- 92 
hg = z(1) — z(3) X (3) = hı + jhe 


which requires only 2 complex multiplications, which is a considerably smaller 
number, even for this simple example. A signal flowgraph structure for this 
algorithm is given in Figure 5.19. 


An Interpretation This efficient algorithm (5.47) can be interpreted differ- 
ently. First, a 4-point sequence x(n) is divided into two 2-point sequences, which 
are arranged into column vectors as shown here. 


les E _ Be ca 
«(2)] ° [2(3) (2) x(3) 


FIGURE 5.19 Signal flowgraph in Example 5.20 
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Second, a smaller 2-point DFT of each column is taken. 


z 
EER | 
8 8 
A > 
y O 
YS a 
8 R 
—_~ > 
WwW rR 
Sp Aa 
i 
II 
pe 
= e 

| 
= e 
sy 
a | 
8 8 
A > 
V oO 
SYS a 
8 8 
—~ > 
wo å =e 
oN 
_—_— 


(0) + 2(2) w(1)+2(3)} |g ge 
Thy he 


Then each element of the resultant matrix is multiplied by {W21}, where p is 
the row index and q is the column index; that is, the following dot-product is 


performed: 
1 y (7% 2) |n 92 
1 -j hı h2 hı —jh2 


Finally, two more smaller 2-point DFTs are taken of row vectors. 


gı 92 W, = gı 92 Dag _ gı +92 gi- ge 
ha —jho] ° [h jha] |, _,| [ha -jha hi + jh 
_ [X(0) X(2) 
g P 


Although this interpretation seems to have more multiplications than the effi- 
cient algorithm, it does suggest a systematic approach of computing a larger 
DFT based on smaller DFTs. 


5.6.1 DIVIDE-AND-COMBINE APPROACH 
To reduce the DFT computation’s quadratic dependence on N, one must 
choose a composite number N = LM since 


L? + M? « N? for large N 


Now divide the sequence into M smaller sequences of length L, compute 
M smaller L-point DFTs, and then combine these into a larger DFT 
using L smaller M-point DFTs. This is the essence of the divide-and- 
combine approach. Let N = LM, then the indices n and k in (5.46) can 
be written as 


n=l+Im,0<€<LD-1,0<m<M-1 
(5.48) 


k=q+Mp,0<p<L—-10<qsM—1 
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and write sequences x(n) and X(k) as arrays x(£,m) and X (p,q), respec- 
tively. Then (5.46) can be written as 


L-1M-1 
X(p,q) = x(t, mW GTa atM) 


L-1 M-1 
£ we E z(l, mw! we (5.49) 
£=0 m=0 
M-point DFT 
L-point DFT 


Hence (5.49) can be implemented as a three-step procedure: 


1. First, we compute the M-point DFT array 
M-1 
FUA X el mWyu O<q<M-1 (5.50) 
m=0 


for each of the rows £ = 0,...,L— 1. 
2. Second, we modify F'(é,q) to obtain another array. 


GU, q) = WE F(t q) tae et (5.51) 
d= N >); 0 < q < M 2: 1 x 
The factor we is called a twiddle factor. 
3. Finally, we compute the L-point DFTs 
pei 
X(p,q) =X GWP 0<p<L-1 (5.52) 
£=0 


for each of the columns q = 0,..., M — 1. 


The total number of complex multiplications for this approach can now 
be given by 
Cyn = LM? + N + ME? < o (N°) (5.53) 


We illustrate this approach in the following example. 
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EXAMPLE 5.21 Develop the divide-and-combine FFT algorithm for N = 15. 


Solution Let L = 3 and M = 5. Then, from (5.48), we have 


n=€+3M, 0<£<2, 0<m<4 


k=q+5p, O<p<2, 0<q<4 Pon 


Hence (5.49) becomes 
2 4 
)d=5 [ wis bs a(l, mur ws? (5.55) 
£=0 m=0 


To implement (5.55), we arrange the given sequence g(n) in the form of 
an array {x(¢,m)} using a column-wise ordering as 


x(0) «x(3) «(6) 2(9) a«(12) 
x(1) x(4) 2(7) (10) 2x(13) (5.56) 
x(2) 2(5) 2(8) x(11) 2(14) 


The first step is to compute 5-point DFTs F'(é,q) for each of the three 
rows and arrange them back in the same array formation 


F(0,0) F(0,1) F(0,2) F(0,3) F(0,4) 
F(1,0) F(1,1) F(1,2) F(1,3) F(1,4) (5.57) 
F(2,0) F(2,1) F(2,2) F(2,3) F(2,4) 


which requires a total of 3 x 5? = 75 complex operations. The second step 
is to modify F'(é,q) to obtain the array G(é,q) using the twiddle factors 
wis 

G(0,0) G(0,1) G(0,2) G(0,3) G(0,4) 

G(1,0) G(1,1) G(1,2) G(1,3) GC, 4) (5.58) 

G(2,0) G(2,1) G(2,2) G(2,3) G(2,4) 


which requires 15 complex operations. The last step is to perform 3-point 
DFTs X (p,q) for each of the five columns to obtain 


X(0,0) X(0,1) X(0,2) X(0,3) X(0,4) 
X(1,0) X(1,1) X(1,2) X(1,3) X(1,4) (5.59) 
X (2,0) X(2,1) X(2,2) X(2,3) X(2,4) 


using a total of 5 x 3? = 45 complex operations. According to (5.54) the 
array in (5.59) is a rearrangement of X(k) as 


X(5) X(6) X(7) X(8) X(9) (5.60) 
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Finally, after “unwinding” this array in the row-wise fashion, we obtain 
the required 15-point DFT X(k). The total number of complex operations 
required for this divide-and-combine approach is 135, whereas the direct 
approach for the 15-point DFT requires 225 complex operations. Thus 
the divide-and-combine approach is clearly efficient. 


The divide-and-combine procedure can be further repeated if M or L 
are composite numbers. Clearly, the most efficient algorithm is obtained 
when N is a highly composite number, that is, N = R”. Such algorithms 
are called radix-R FFT algorithms. When N = RI'R? ..., then such de- 
compositions are called mized-radiz FFT algorithms. The one most pop- 
ular and easily programmable algorithm is the radix-2 FFT algorithm. 


5.6.2 RADIX-2 FFT ALGORITHM 
Let N = 2”; then we choose L = 2 and M = N/2 and divide x(n) into 
two N/2-point sequences according to (5.48) as 
=0(2 
gi(n) = x(2n) n eee = 
goln) = x(2n + 1) 2 


The sequence gı(n) contains even-ordered samples of x(n), while g2(n) 
contains odd-ordered samples of x(n). Let Gi(k) and G2(k) be N/2-point 
DFTs of gi(n) and g2(n), respectively. Then (5.49) reduces to 


X(k) = Gi(k) + WEGo(k), O<k<N-1 (5.61) 


This is called a merging formula, which combines two N/2-point DFTs 
into one N-point DFT. The total number of complex multiplications re- 


duces to 
2 


Cy = A +N =0(N?/2) 

This procedure can be repeated again and again. At each stage the 
sequences are decimated and the smaller DFTs combined. This decima- 
tion ends after v stages when we have N one-point sequences, which are 
also one-point DFTs. The resulting procedure is called the decimation-in- 
time FFT (DIT-FFT) algorithm, for which the total number of complex 
multiplications is 

Cy = Nv = N log, N 


Clearly, if N is large, then Cy is approximately linear in N, which was 
the goal of our efficient algorithm. Using additional symmetries, C'y can 
be reduced to + logy N. The signal flowgraph for this algorithm is shown 
in Figure 5.20 for N = 8. 
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FIGURE 5.20 Decimation-in-time FFT structure for N = 8 


In an alternate approach we choose M = 2, L = N/2 and follow 
the steps in (5.49). Note that the initial DFTs are 2-point DFTs, which 
contain no complex multiplications. From (5.50) 


F(0,m) = 2(0,m) + z(1,m)W9 

= x(n) +a(n+ N/2), O<n< N/2 
F(1,m) = a(0,m) + 2(1,m)W3 
(n) —a(n+ N/2), O<n< N/2 


8 


and from (5.51) 
G(0,m) = F(0,m)WR, 
=2(n)+a(n+N/2), O<n< N/2 
G(1,m) = F(1,m)WẸ 
= (x(n) — a(n + N/2)] WR, 0<n<N/2 


(5.62) 
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Let G(0,m) = di(n) and G(1,m) = d2(n) for 0 < n < N/2— 1 (since 
they can be considered as time-domain sequences); then from (5.52) we 
have 

X(0,q)=X(2q) = Di(q) 


(5.63) 
X(1,q) = X(2q+ 1) = Da(q) 


This implies that the DFT values X(k) are computed in a decimated 
fashion. Therefore this approach is called a decimation-in-frequency FFT 
(DIF-FFT) algorithm. Its signal flowgraph is a transposed structure of 
the DIT-FFT structure, and its computational complexity is also equal 
to + logs N. 


5.6.3 MATLAB IMPLEMENTATION 
MATLAB provides a function called fft to compute the DFT of a vec- 
tor x. It is invoked by X = fft(x,N), which computes the N-point DFT. 
If the length of x is less than N, then x is padded with zeros. If the argu- 
ment N is omitted, then the length of the DFT is the length of x. If x is a 
matrix, then fft(x,N) computes the N-point DFT of each column of x. 
This fft function is written in machine language and not using 
MATLAB commands (i.e., it is not available as a .m file). Therefore it 
executes very fast. It is written as a mixed-radix algorithm. If N is a 
power of two, then a high-speed radix-2 FFT algorithm is employed. If 
N is not a power of two, then N is decomposed into prime factors and 
a slower mixed-radix FFT algorithm is used. Finally, if N is a prime 
number, then the fft function is reduced to the raw DFT algorithm. 
The inverse DFT is computed using the ifft function, which has the 
same characteristics as fft. 


EXAMPLE 5.22 In this example we will study the execution time of the fft function for 1 < 
N < 2048. This will reveal the divide-and-combine strategy for various values 
of N. One note of caution. The results obtained in this example are valid only 
for MATLAB Versions 5 and earlier. Beginning in Version 6, MATLAB is using 
a new numerical computing core called LAPACK. It is optimized for memory 
references and cache usage and not for individual floating-point operations. 
Therefore, results for Version 6 and later are difficult to interpret. Also the 
execution times given here are for a specific computer and may vary on different 
computers. 


Solution To determine the execution time, MATLAB provides two functions. The clock 
function provides the instantaneous clock reading, while the etime (t1,t2) func- 
tion computes the elapsed time between two time marks t1 and t2. To determine 
the execution time, we will generate random vectors from length 1 through 2048, 
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compute their FFTs, and save the computation time in an array. Finally, we 
will plot this execution time versus N. 


MATLAB script: 


>> Nmax = 2048; fft_time=zeros(1,Nmax) ; 
>> for n=1:1:Nmax 


>> x=rand(1,n); 
>> t=clock;fft (x) ;fft_time(n)=etime(clock,t) ; 
>> end 


>> n=[1:1:Nmax] ; plot(n,fft_time,’.’) 
>> xlabel(’N’);ylabel(’Time in Sec.’) title(’FFT execution times’) 


The plot of the execution times is shown in Figure 5.21. This plot is very 
informative. The points in the plot do not show one clear function but appear 
to group themselves into various trends. The uppermost group depicts a o(N?) 
dependence on N, which means that these values must be prime numbers be- 
tween 1 and 2048 for which the FFT algorithm defaults to the DFT algorithm. 
Similarly, there are groups corresponding to the o (N?/2), o (N?/3), o (N?/4), 
and so on, dependencies for which the number N has fewer decompositions. 
The last group shows the (almost linear) o (N log N) dependence, which is for 


FFT execution times 
50 T T T 


45} = | 


o 

o 

op) 

© 25} A J 
a ee | o(N*N/2) 
E r 


0 500 1000 1500 2000 2500 
N 


FIGURE 5.21 FFT execution times for 1 <= N <= 2048 
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N =2”,0 < v < 11. For these values of N, the radix-2 FFT algorithm is used. 
For all other values, a mixed-radix FFT algorithm is employed. This shows that 
the divide-and-combine strategy is very effective when N is highly composite. 
For example, the execution time is 0.16 sec for N = 2048, 2.48 sec for N = 2047, 
and 46.96 sec for N = 2039. 


The MATLAB functions developed previously in this chapter should 
now be modified by substituting the fft function in place of the dft 
function. From the preceding example care must be taken to use a highly 
composite N. A good practice is to choose N = 2” unless a specific 
situation demands otherwise. 


5.6.4 FAST CONVOLUTIONS 

The conv function in MATLAB is implemented using the filter function 
(which is written in C) and is very efficient for smaller values of N (< 50). 
For larger values of N it is possible to speed up the convolution using the 
FFT algorithm. This approach uses the circular convolution to implement 
the linear convolution, and the FFT to implement the circular convolu- 
tion. The resulting algorithm is called a fast convolution algorithm. In 
addition, if we choose N = 2” and implement the radix-2 FFT, then the 
algorithm is called a high-speed convolution. Let x1 (n) be a N-point se- 
quence and 22 (n) be a Nz-point sequence; then for high-speed convolution 
N is chosen to be 


N = glloga(Ni+Na—1)| (5.64) 
where [x] is the smallest integer greater than x (also called a ceiling 
function). The linear convolution xı (n) * #2 (n) can now be implemented 
by two N-point FFTs, one N-point IFFT, and one N-point dot-product. 

xı (n) * xə (n) = IFFT [FFT [xq (n)| - FFT [z2 (n)]] (5.65) 


For large values of N, (5.65) is faster than the time-domain convolution, 
as we see in the following example. 


EXAMPLE 5.23 ‘To demonstrate the effectiveness of the high-speed convolution, let us compare 
the execution times of two approaches. Let xı (n) be an L-point uniformly 
distributed random number between [0, 1], and let x2 (n) be an L-point Gaussian 
random sequence with mean 0 and variance 1. We will determine the average 
execution times for 1 < L < 150, in which the average is computed over the 
100 realizations of random sequences. (Please see the cautionary note given in 
Example 5.22.) 
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Solution MATLAB script: 


conv_time = zeros(1,150); fft_time = zeros(1,150); 
h 
for L = 1:150 
tc = 0; tf=0; 
N = 2*L-1; nu = ceil(log10(NI)/log10(2)); N = 2^nu; 
for I=1:100 
h = randn(1,L); x = rand(1,L); 
tO = clock; yl = conv(h,x); ti=etime(clock,t0); tc = tc+t1; 
tO = clock; y2 = ifft(fft(h,N) .+*fft(x,N)); t2=etime(clock,t0) ; 


tf = tf+t2; 
end 
h 
conv_time(L)=tc/100; fft_time(L)=tf/100; 
end 
h 


n = 1:150; subplot(1,1,1); 
plot (n(25:150) , conv_time(25:150) ,n(25:150) ,fft_time(25:150)) 


Figure 5.22 shows the linear convolution and the high-speed convolution times 
for 25 < L < 150. It should be noted that these times are affected by the 


Comparison of convolution times 
0.35 T T 
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FIGURE 5.22 Comparison of linear and high-speed convolution times 
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computing platform used to execute the MATLAB script. The plot in Figure 5.22 
was obtained on a 33 MHz 486 computer. It shows that for low values of L 
the linear convolution is faster. The crossover point appears to be L = 50, 
beyond which the linear convolution time increases exponentially, while the 
high-speed convolution time increases fairly linearly. Note that since N = 2”, 
the high-speed convolution time is constant over a range on L. 


5.6.5 HIGH-SPEED BLOCK CONVOLUTIONS 

Earlier we discussed a block convolution algorithm called the overlap-and- 
save method (and its companion the overlap-and-add method), which is 
used to convolve a very large sequence with a relatively smaller sequence. 
The MATLAB function ovrlpsav developed in that section uses the DFT 
to implement the linear convolution. We can now replace the DFT by the 
radix-2 FFT algorithm to obtain a high-speed overlap-and-save algorithm. 
To further reduce the computations, the FFT of the shorter (fixed) se- 
quence can be computed only once. The following hsolpsav function 
shows this algorithm. 


function [y] = hsolpsav(x,h,N) 
% High-speed Overlap-Save method of block convolutions using FFT 


% [y] = hsolpsav(x,h,N) 
y = output sequence 
x = input sequence 
% h = impulse response 
N = block length (must be a power of two) 


N = 27(ceil(log10(N)/logi0(2)) ; 
Lenx = length(x); M = length(h); 
M1 = M-1; L = N-M1; h = fft(h,N); 
% 


x = [zeros(1,M1), x, zeros(1,N-1)]; 
K = floor((Lenx+M1-1)/(L)); % # of blocks 
Y = zeros(K+1,N); 


for k=0:K 

xk = fft (x(k*L+1:k*L+N)); 
Y(k+1,:) = real (ifft(xk.*h)); 
end 

YS We MEN) 23 yy = ORs)? 2 


A similar modification can be done to the overlap-and-add algorithm. 
MATLAB also provides the function fftfilt to implement the overlap- 
and-add algorithm. 
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5.7 PROBLEMS 
—— g 


P5.1 Compute the DFS coefficients of the following periodic sequences using the DFS definition, 
and then verify your answers using MATLAB. 

žı(n) = {4,1,-1,1}, N= 4 

&2(n) = {2,0,0,0,—1,0,0,0}, N = 8 

&3(n) = {1,0,—1,—1,0}, N =5 

&a(n) = {0,0, 27,0, 27,0}, N =6 

&5(n) = {3,2,1}, N=3 


Cr Go. Ne 


P5.2 Determine the periodic sequences given the following periodic DFS coefficients. First use 
the IDFS definition and then verify your answers using MATLAB. 


1. X1(k) = {4,3j,-37}, N =3 


P5.3 Let %i(n) be periodic with fundamental period N = 40 where one period is given by 


2 _ J 5sin(0.1mn), 0<n<19 
ı(n) = 0, 20 < n < 39 


and let %2(n) be periodic with fundamental period N = 80, where one period is given by 


najs 5sin(0.1rn), 0<n<19 
tan = 0, 20<n<79 


These two periodic sequences differ in their periodicity but otherwise have the same 
nonzero samples. 


1. Compute the DFS X; (k) of #1(n), and plot samples (using the stem function) of its 
magnitude and angle versus k. 

2. Compute the DFS X2(k) of #2(n), and plot samples of its magnitude and angle versus k. 

3. What is the difference between the two preceding DFS plots? 


P5.4 Consider the periodic sequence %1(n) given in Problem P5.3. Let %2(n) be periodic with 
fundamental period N = 40, where one period is given by 


ane &1(n), 0<n<19 
awe) a(n — 20), 20 < n < 39 


1. Determine analytically the DFS Xo(k) in terms of Xı (k). 
2. Compute the DFS X2(k) of Z2(n) and plot samples of its magnitude and angle versus k. 
3. Verify your answer in part 1 using the plots of X1(k) and X2(k)? 


P5.5 Consider the periodic sequence %1(n) given in Problem P5.3. Let %3(n) be periodic with 
period 80, obtained by concatenating two periods of %1(n), i.e., 


&3(n) = [či (n), £1(”) PERIODIC 
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Clearly, @3(n) is different from %2(n) of Problem P5.3 even though both of them are 
periodic with period 80. 


1. Compute the DFS X3(k) of a(n), and plot samples of its magnitude and angle versus k. 
2. What effect does the periodicity doubling have on the DFS? 
3. Generalize this result to M-fold periodicity. In particular, show that if 


M times PERIODIC 
then 


Xu (Mk) = MXi(k), k=0,1,...,N—-1 
Xu(k) =0, k#0,M,...,MN 


P5.6 Let X(e%”) be the DTFT of a finite-length sequence 


100 — n, 50 < n < 99; 


n+1, O0<n< 49; 
x(n) = 
0, otherwise. 


1. Let 


10-point : . : : 
y(n) = IDFS [X(e%), X (e17), X (e147), ... , X(e787/)] 


Determine yı(n) using the frequency sampling theorem. Verify your answer using 
MATLAB. 
2. Let 


200-point , l , “3 
yo(n) = IDFS [X(e°), X (ef?™/200) X (ef47/200) T , X (e1®987/200)] 


Determine y2(n) using the frequency sampling theorem. Verify your answer using 
MATLAB. 
3. Comment on your results in parts (a) and (b). 


P5.7 Let Z(n) be a periodic sequence with period N and let 


gln) Ê &(—n) = (N — n) 


that is, (n) is a periodically folded version of (n). Let X (k) and Y(k) be the DFS 
sequences. 


1. Show that 


Ý (k) = X(—k) = X(N —k) 


that is, Y(k) is also a periodically folded version of X (k). 
2. Let &(n) = {2, 4,6,1,3, 5}PERIODIC with N = 6. 
T 
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(a) Sketch g(n) forO<n<5. 

(b) Compute X(k) for 0 < k <5. 

(c) Compute Ý (k) for 0 < k < 5. 
) 


(d) Verify the relation in part 1. 


P5.8 Consider the following finite-length sequence. 


ais sinc?{ (n — 50)/2}, 0 < n < 100; 
~ | 0, else. 


1. Determine the DFT X(k) of x(n). Plot (using the stem function) its magnitude and 
phase. 

2. Plot the magnitude and phase of the DIFT X(e”) of x(n) using MATLAB. 

3. Verify that the above DFT is the sampled version of X(e’”). It might be helpful to 
combine the above two plots in one graph using the hold function. 

4. Is it possible to reconstruct the DIFT X(e%”) from the DFT X(k)? If possible, give the 
necessary interpolation formula for reconstruction. If not possible, state why this 
reconstruction cannot be done. 


P5.9 Let a finite-length sequence be given by 


ae Qe I"l 5 <n < 5; 
0, otherwise. 


Plot the DTFT X(e%”) of the above sequence using DFT as a computation tool. Choose the 
length N of the DFT so that this plot appears to be a smooth graph. 


P5.10 Plot the DTFT magnitude and angle of each of the following sequences using the DFT as a 
computation tool. Make an educated guess about the length N so that your plots are 
meaningful. 

1. x(n) = (0.6)!"! [u(n + 10) — u(n — 11). 

2. x(n) = n(0.9)” [u(n) — u(n — 21)]. 

3. x(n) = [cos(0.57n) + j sin(0.57n)][u(n) — u(n — 51)]. 

4. x(n) = {1, 2,3, 4,3, 2,1}. 

T 


5. a(n) = {—1, —2, —3, 0, 3, 2, 1}. 
T 


P5.11 Let H(e?”) be the frequency response of a real, causal discrete-time LSI system. 
1. If 


Re {H (°) } = (0.9)* cos (kw) 
k=0 
determine the impulse response h(n) analytically. Verify your answer using DFT as a 


computation tool. Choose the length N appropriately. 
2. If 


Im {H (e*)} = S X sin (lw), and I H(e?”)dw = 0 
£=0 = 
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determine the impulse response h(n) analytically. Verify your answer using DFT as a 
computation tool. Again choose the length N appropriately. 


P5.12 Let X(k) denote the N-point DFT of an N-point sequence x(n). The DFT X(k) itself is an 
N-point sequence. 


1. If the DFT of X(k) is computed to obtain another N-point sequence x(n), show that 
ti(n) = Na((—n))n, O<n<N-1 


2. Using this property, design a MATLAB function to implement an N-point circular 
folding operation xr2(n) = 21((—n))n. The format should be 


x2 = circfold(x1i,N) 

% Circular folding using DFT 

4, x2 = circfold(xi,N) 

% x2 = circularly folded output sequence 
% x1 = input sequence of length <= N 

% N = circular buffer length 


3. Determine the circular folding of the following sequence. 
xı(n) = {1, 3,5,7,9, —7, —5, —3, —1} 
P5.13 Let X(k) be an N-point DFT of an N-point sequence x(n). Let N be an even integer. 


1. If x(n) = a(n + N/2) for all n, then show that X(k) = 0 for k odd (i.e., nonzero for k 
even). Verify this result for x(n) = {1, 2, —3, 4,5, 1, 2, —3, 4, 5}. 

2. If x(n) = —a(n + N/2) for all n, then show that X(k) = 0 for k even (i.e., nonzero for 
k odd). Verify this result for a(n) = {1, 2, —3, 4,5, —1, —2, 3, —4, —5}. 


P5.14 Let X(k) be an N-point DFT of an N-point sequence x(n). Let N = 4v where v is an 
integer. 


1. If x(n) = a(n +v) for all n, then show that X(k) is nonzero for k = 42 for 0 < L< v- 1. 
Verify this result for x(n) = {1, 2,3, 1, 2,3, 1, 2,3, 1,2, 3}. 

2. If a(n) = —a(n + v) for all n, then show that X(k) is nonzero for k = 4 + 2 for 
0< £< v- l1. Verify this result for x(n) = {1, 2,3, —1, —2, —3, 1, 2,3, —1, —2, —3}. 


P5.15 Let X(k) be an N-point DFT of an N-point sequence x(n). Let N = 2uv where p and v are 
integers. 


1. If e(n) = x(n + v) for all n, then show that X(k) is nonzero for k = 2(yl) for 0 < £ < 
v — 1. Verify this result for x(n) = {1, —2, 3, 1, —2, 3, 1, —2, 3, 1, —2, 3, 1, —2, 3,1, —2, 3}. 

2. If a(n) = —a2(n + v) for all n, then show that X(k) is nonzero for k = 2(yé + 1) for 
0<£<v-—1. Verify this result for z(n) = {1, —2, 3, —1, 2, —3, 1, —2, 3, —1, 2, —3, 1, —2, 
3 =]; igh 


P5.16 Let X(k) and Y (k) be 10-point DFTs of two 10-point sequences x(n) and y(n), 
respectively. If 


X (k) = exp(j0.2rk), O<k<9 


determine Y (k) in each of the following cases without computing the DFT. 
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1. y(n) = z((n — 5))J10 
2. y(n) = a((n+4))10 
3. y(n) = z((3 —n))10 
4. y(n) = a(n)e37™/5 
5. y(n) = a(n) QO) 2((—n))10 


Verify your answers using MATLAB. 
P5.17 The first six values of the 10-point DFT of a real-valued sequence x(n) are given by 


{10, —2 + 73,3 + 74,2 — j3, 4 + 95, 12} 
Determine the DFT of each of the following sequences using DFT properties. 


x(n) = a((2—n))10 
x2(n) = a((n +5))10 

x3(n) = a(n)x((—n)) 10 
xa(n) = z(n) QD «((—n))10 


5. a5(n) = a(n)eI47"/® 


ee Co IN 


P5.18 Complex-valued N-point sequence x(n) can be decomposed into N-point circular-conjugate- 
symmetric and circular-conjugate-antisymmetric sequences using the following relations 


ees(n) Ê 5 le(n) + 2° ((—n))w 


teea(n) È 5 [e(n) — «*((—n))w 


If Xp(k) and X1(k) are the real and imaginary parts of the N-point DFT of x(n), then 


DFT [accs(n)] = Xr(k) and DFT [acca(n)] = 7 X1(k) 


1. Prove these relations property analytically. 

2. Modify the circevod function developed in the chapter so that it can be used for 
complex-valued sequences. 

3. Let X(k) = [3 cos(0.27k) + j4sin(0.17k)][u(k) — u(k — 20)] be a 20-point DFT. Verify 
this symmetry property using your circevod function. 


P5.19 If X(k) is the N-point DFT of an N-point complex-valued sequence 
a(n) = er(n) + jar(n) 
where xp(n) and 21(n) are the real and imaginary parts of x(n), then 
DFT [rr(n)] = Xees(k) and DFT [jat(n)] = Xcca(k) 


where Xces(k) and Xcca(k) are the circular-even and circular-odd components of X (k) as 
defined in Problem P5.18. 


1. Prove this property analytically. 

2. This property can be used to compute the DFTs of two real-valued N-point sequences 
using one N-point DFT operation. Specifically, let xı(n) and x2(n) be two N-point 
sequences. Then we can form a complex-valued sequence 


x(n) = zı (n) + jz2(n) 
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and use this property. Develop a MATLAB function to implement this approach with 
the following format. 


function [X1,X2] = real2dft(x1,x2,N) 
% DFTs of two real sequences 

% [X1,X2] = real2dft(x1,x2,N) 

% X1 = n-point DFT of x1 

% X2 = n-point DFT of x2 

% x1 = sequence of length <= N 

% x2 = sequence of length <= N 

% N= length of DFT 


3. Compute and plot the DFTs of the following two sequences using this function. 
x1(n) = cos(0.1lmn), x2(n) = sin(0.27n); O<n< 39 


P5.20 Using the frequency domain approach, devise a MATLAB function to determine a circular 
shift z((n — m))n, given an N,-point sequence x(n) where Nı < N. Your function should 
have the following format. 


function y = cirshftf(x,m,N) 
% Circular shift of m samples wrt size N in sequence x: (freq domain) 


ya aee a a aan 
% y = cirshftf(x,m,N) 

% y : output sequence containing the circular shift 

h x : input sequence of length <= N 

% m : sample shift 

% N : size of circular buffer 

% Method: y(n) = idft(dft(x(n))*WN^ (mk)) 

hh 


% If m is a scalar then y is a sequence (row vector) 

% If m is a vector then y is a matrix, each row is a circular shift 
hh in x corresponding to entries in vecor m 

% M and x should not be matrices 


Verify your function on the following sequence 


a(n) = {5, 4,3,2, 1,0,0, 1,2,3,4}, O<n< 10 
T 


with (a) m = —5, N = 12 and (b) m = 8, N = 15. 


P5.21 Using the analysis and synthesis equations of the DFT, show that the energy of a sequence 
satisfies 


ex 2 eP = +S xr 
n=0 


k=0 


This is commonly referred to as a Parseval’s relation for the DFT. Verify this relation using 
MATLAB on the sequence in Problem P5.20. 
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P5.22 A 512-point DFT X(k) of a real-valued sequence x(n) has the following DFT values: 


X(0)=20+ ja;  -X(5)=20+ 530; X(ki)=—10 +915; X(152)=17 + 23; 
X (ko) =20 — 530; X(k3) =17— 23; X(480) =—-10—j15; X(256)=304 58 


and all other values are known to be zero. 


1. Determine the real-valued coefficients a and 8. 

2. Determine the values of the integers kı, k2, and ks. 
3. Determine the energy of the signal x(n). 

4. Express the sequence x(n) in a closed form. 


P5.23 Let x(n) be a finite length sequence given by 


a(n) = {10404012 -3.4,-8,0,..-b 
T 


Determine and sketch the sequence «((—8 — n))7R7(n) where 


10<n<6 
Ryn) = { 0, elsewhere 
P5.24 The circonvt function developed in this chapter implements the circular convolution as a 
matrix-vector multiplication. The matrix corresponding to the circular shifts {x((n — m))n; 
0<n <N- 1} has an interesting structure. This matrix is called a circulant matrix, which 
is a special case of Toeplitz matrix introduced in Chapter 2. 


1. Consider the sequences given in Example 5.13. Express xı(n) as a column vector xı and 
x2((n —m))wn as a circulant matrix X2 with rows corresponding to n = 0,1, 2,3. 
Characterize this matrix X2. Can it completely be described by its first row (or column)? 

2. Determine the circular convolution as X2x, and verify your calculations. 


P5.25 Develop a MATLAB function to construct a circulant matrix C given an N-point sequence 
x(n). Use the toeplitz function to implement matrix C. Your subroutine function should 
have the following format: 


function [C] = circulnt(x,N) 

% Circulant Matrix from an N-point sequence 
% [C] = circulnt(x,N) 

% C = circulant matrix of size NxN 

sequence of length <= N 


x x 
zZ M 
iow 


size of circulant matrix 


Using this function, modify the circular convolution function circonvt discussed in the 


chapter so that the for...end loop is eliminated. Verify your functions on the sequences in 
Problem P5.24. 


P5.26 Using the frequency domain approach, devise a MATLAB function to implement the 
circular convolution operation between two sequences. The format of the sequence should be 
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function x3 = circonvf(x1,x2,N) 

% Circular convolution in the frequency domain 
% x3 = circonvf (x1,x2,N) 

% x3 = convolution result of length N 

% x1 = sequence of length <= N 

% x2 = sequence of length <= N 

% N= length of circular buffer 


Using your function, compute the circular convolution {4, 3, 2, 1} © {1,2,3,4}. 


P5.27 The following four sequences are given: 
zı(n) = {1,3,2,—1}; z2(n) = {2, 1,0, —1}; x(n) = a(n) * za(n); za(n) = zı(n) ©) z2(n) 
T T 


1. Determine and sketch x3(n). 
2. Using x3(n) alone, determine and sketch x4(n). Do not directly compute x4(n). 


P5.28 Compute the N-point circular convolution for the following sequences. Plot their samples. 
1. x(n) =sin(7n/3)Re(n), x(n) = cos(7n/4)Re(n); N= 10 

1(n) = cos (2an/N) Rx (n), em = sin (2rn/N) Rn (n); N =732 

1(n) = (0.8)" Ru (n), x(n) = (—0.8)" Ry (n); N =20 
4. x(n) =nRwn(n), am =(N - n) Rath ); N=10 

x1(n) = (0.8)" R2, x2(n) = u(n) — u(n — 40); N =50 

P5.29 Let x1(n) and x2(n) be two N-point sequences. 
1. If y(n) = zı (n) O) x2(n) show that 


OL (Sine) (Se) 
n=0 n=0 


2. Verify this result for the following sequences. 


x(n) = {9, 4, 1,4, —4, 1,8, 3}; x(n) = { 5, 6,2, —7, —5, 2, 2, 2} 
P5.30 Let X(k) be the 8-point DFT of a 3-point sequence x(n) = {5, —4,3}. Let Y (k) be the 
T 
8-point DFT of a sequence y(n). Determine y(n) when Y (k) = We" X (—k)s. 
P5.31 For the following sequences compute (i) the N-point circular convolution z3(n) = xı (n) 


O) x2(n), (ii) the linear convolution z4(n) = xı (n) * x2(n), and (iii) the error sequence 
e(n) = z3(n) — z4 (n). 


1. xı(n) = {1,1,1,1}, we(n) = cos(mn/4)Re(n); N=8 

2. xı(n) = cos (2rn/N) Ris(n), es = sin (27n/N) Rie(n); N = 32 
: t1(n) = (0.8)" Rio(n), æ2(n) = (—0.8)" Rio(n); N= 15 

5. 


r1(n) =nRio(n), r2(n) =(N—n) Rio(n); N= 10 
x1i(n) = {1,-1,1,-1}, a(n) 


In each case verify that e(n) = x4 (n + N). 


= {1,0,—1,0}; N=5 
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P5.32 The overlap-add method of block convolution is an alternative to the overlap-save method. 
Let x(n) be a long sequence of length ML where M, L > 1. Divide x(n) into M segments 
{£m(n), m = 1,..., M} each of length L 


M-1 
_ J a(n), mL<n<(m+1)L-1 =: 
Lm(n) = { 0, Cente so that a(n) = Se Lm(n) 


Let h(n) be an L-point impulse response. Then 


M-1 M-1 


y(n) = a(n) * h(n) = Y am(n) * h(n) = X vml) yaln) E em(n) * h(n) 


m=0 m=0 


Clearly, ym(n) is a (2L — 1)-point sequence. In this method we have to save the 
intermediate convolution results and then properly overlap these before adding to form the 
final result y(n). To use DFT for this operation we have to choose N > (2L — 1). 


1. Develop a MATLAB function to implement the overlap-add method using the circular 
convolution operation. The format should be 


function [y] = ovrlpadd(x,h,N) 
% Overlap-Add method of block convolution 
% [y] = ovrlpadd(x,h,N) 


hh 

% y = output sequence 

% x = input sequence 

% h = impulse response 

% N = block length >= 2*length(h)-1 


2. Incorporate the radix-2 FFT implementation in this function to obtain a high-speed 
overlap-add block convolution routine. Remember to choose N = 2”. 
3. Verify your functions on the following two sequences 


x(n) = cos(7n/500) Raooo(n), h(n) = {1,—1,1,—1} 
P5.33 Given the following sequences x(n) and x2(n): 
xi(n) = {2,1,1,2}, we(n) = {1,-1,-1, 1} 


1. Compute the circular convolution x1(n) O) x2(n) for N = 4, 7, and 8. 

2. Compute the linear convolution xı(n) * x2(n). 

3. Using results of calculations, determine the minimum value of N necessary so that linear 
and circular convolutions are same on the N-point interval. 

4. Without performing the actual convolutions, explain how you could have obtained the 
result of P5.33.3. 


P5.34 Let 


OE o NPRD Cane NL _ Acos (2nén/N) Rx (n) 


0, elsewhere 
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where £ is an integer. Notice that x(n) contains exactly £ periods (or cycles) of the cosine 
waveform in N samples. This is a windowed cosine sequence containing no leakage. 


1. Show that the DFT X(k) is a real sequence given by 


2. Show that if £ = 0, then the DFT X(k) is given by 
X(k) = AN6(k); O<k<(N-1) 


3. Explain clearly how these results should be modified if £ < 0 or £> N. 
4. Verify the results of parts 1, 2, and 3 using the following sequences. Plot the real parts of 
the DFT sequences using the stem function. 
(a) x1(n) = 3cos (0.0477) R(n) 
(b) z2 
(c) 
(d) T4 
(e) 
P5.35 Let x(n) = Acos (won) Ry (n), where wo is a real number. 


1. Using the properties of the DFT, show that the real and the imaginary parts of X (k) are 
given by 
X(k)=Xr(k)+jXr(k) 

sin [r (k — foN)] 
sin [r(k — foN)/N] 

sin [r (k — N + foN)] 
sin [r(k — N + foN)/N] 

sin [r (k — foN)] 
sin [r(k — foN)/N] 

sin [r (k — N + foN)] 
sin [r(k — N + foN)/N] 


Xr(k) = (4/2) cos [E (k — foN)] 


+ (4/2) cos [ZA (k + foN)] 


X1(k) =— (4/2) sin [EF (k — foN)] 


— (A/2) sin [ZE (k + foN)] 


2. This result implies that the original frequency wo of the cosine waveform has leaked into 
other frequencies that form the harmonics of the time-limited sequence, and hence it is 
called the leakage property of cosines. It is a natural result due to the fact that 
bandlimited periodic cosines are sampled over noninteger periods. Explain this result 
using the periodic extension %(n) of x(n) and the result in Problem P5.34.1. 

3. Verify the leakage property using x(n) = cos (57n/99) R200(n). Plot the real and the 
imaginary parts of X(k) using the stem function. 


P5.36 Let 


= Asin (2nfn/N) Ry (n) 


n= Asin (27én/N), 0<n<N-1 
~ \0, Elsewhere 
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where £ is an integer. Notice that x(n) contains exactly £ periods (or cycles) of the sine 
waveform in N samples. This is a windowed sine sequence containing no leakage. 


1. Show that the DFT X(k) is a purely imaginary sequence given by 


S(k-N+2); O0<k<(N-1), 0<£<N 
2. Show that if 2 = 0, then the DFT X(k) is given by 
X(k)=0; O<k<(N-1) 


3. Explain clearly how these results should be modified if £ < 0 or £> N. 
4. Verify the results of parts 1, 2, and 3 using the following sequences. Plot the imaginary 
parts of the DFT sequences using the stem function. 


(a) x1(n) = 3sin (0.047n) Reoo(n) 
(b) za(n) = 5sin 107nRs50(n) 
(c) x3(n) = [2sin (0.57n) + sin (77)] Rioo(n) 
(d) wva(n) = sin (2577/16) Rea(n) 

) 25(n) = [4sin (0.17n) — 3sin (1.977)] Reo(n) 
P5.37 Let x(n) = Asin (won) Rn (n), where wo is a real number. 


1. Using the properties of the DFT, show that the real and the imaginary parts of X (k) are 
given by 


X(k) = Xr(k) + jXi(k) 
sin [r (k — foN)| 
sin [r(k — foN)/N] 
sin [r (k — N + foN)] 
sin [t(k — N + foN)/N] 
sin [r (k — foN)] 
sin [7(k — foN)/N] 
sin [r (k — N + foN)| 
sin [r(k — N + foN)/N] 


Xr(k) = — (4/2) sin [SF (k — foN)] 


+ (4/2) sin [ZE (k + foN)] 


X1(k) = — (4/2) cos [ZS (k — foN)] 


+ (4/2) cos [ZA (k + foN)] 


2. This result is the leakage property of sines. Explain it using the periodic extension (n) 
of a(n) and the result in Problem P5.36.1. 

3. Verify the leakage property using x(n) = sin (577/99) Rioo(n). Plot the real and the 
imaginary parts of X(k) using the stem function. 


P5.38 An analog signal £a(t) = 2sin (4mt) + 5 cos (87t) is sampled at t = 0.01n for 
n=0,1,...,N—1 to obtain an N-point sequence x(n). An N-point DFT is used to obtain 
an estimate of the magnitude spectrum of a(t). 


1. From the following values of N, choose the one that will provide the accurate estimate of 
the spectrum of za(t). Plot the real and imaginary parts of the DFT spectrum X(k). 
(a) N = 40, (b) N = 50, (c) N = 60. 
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2. From the following values of N, choose the one that will provide the least amount of 
leakage in the spectrum of xa(t). Plot the real and imaginary parts of the DFT spectrum 
X(k). (a) N = 90, (b) N = 95, (c) N = 99. 


P5.39 Using (5.49), determine and draw the signal flow graph for the N = 8 point, radix-2 
decimation-in-frequency FFT algorithm. Using this flow graph, determine the DFT of the 
sequence 


x(n) =cos(mn/2), O<n<7 


P5.40 Using (5.49), determine and draw the signal flow graph for the N = 16 point, radix-4 
decimation-in-time FFT algorithm. Using this flow graph, determine the DFT of the 
sequence 


x(n) =cos(mn/2), O<n<15 
P5.41 Let x(n) be a uniformly distributed random number between [—1, 1] for 0 < n < 10°. Let 
h(n) = sin(0.47n), O<n< 100 


1. Using the conv function, determine the output sequence y(n) = x(n) * h(n). 

2. Consider the overlap-and-save method of block convolution along with the FFT 
algorithm to implement high-speed block convolution. Using this approach, determine 
y(n) with FFT sizes of 1024, 2048, and 4096. 

3. Compare these approaches in terms of the convolution results and their execution times. 
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CHAPTER 


Implementation 
of Discrete-time 
Filters 


In earlier chapters we studied the theory of discrete systems in both the 
time and frequency domains. We will now use this theory for the process- 
ing of digital signals. To process signals, we have to design and implement 
systems called filters (or spectrum analyzers in some contexts). The filter 
design issue is influenced by such factors as the type of the filter (i.e., TR 
or FIR) or the form of its implementation (structures). Hence, before we 
discuss the design issue, we first concern ourselves with how these filters 
can be implemented in practice. This is an important concern because 
different filter structures dictate different design strategies. 

IIR filters as designed and used in DSP, can be modeled by rational 
system functions or, equivalently, by difference equations. Such filters are 
termed autoregressive moving average (ARMA) or, more generally, as re- 
cursive filters. Although ARMA filters include moving average filters that 
are FIR filters, we will treat FIR filters separately from IIR filters for both 
design and implementation purposes. 

In addition to describing various filter structures, we also begin to con- 
sider problems associated with quantization effects when finite-precision 
arithmetic is used in the implementation. Digital hardware contains pro- 
cessing elements that use finite-precision arithmetic. When filters are im- 
plemented either in hardware or in software, filter coefficients as well as 
filter operations are subjected to the effects of these finite-precision op- 
erations. In this chapter, we treat the effects on filter frequency response 
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characteristics due to coefficient quantization. In Chapter 10, we will con- 
sider the round-off noise effects in the digital filter implementations. 

We begin with a description of basic building blocks that are used 
to describe filter structures. In the subsequent sections, we briefly de- 
scribe IIR, FIR, and lattice filter structures, respectively, and provide 
MATLAB functions to implement these structures. This is followed by 
a brief treatment of the representation of numbers and the resulting er- 
ror characteristics, which is then used to analyze coefficient quantization 
effects. 


6.1 BASIC ELEMENTS 
————— SES 


Since our filters are LTI systems, we need the following three elements to 
describe digital filter structures. These elements are shown in Figure 6.1. 


1. Adder: This element has two inputs and one output and is shown in 
Figure 6.la. Note that the addition of three or more signals is imple- 
mented by successive two-input adders. 

2. Multiplier (gain): This is a single-input, single-output element and is 
shown in Figure 6.1b. Note that the multiplication by 1 is understood 
and hence not explicitly shown. 


3. Delay element (shifter or memory): This element delays the sig- 
nal passing through it by one sample, as shown in Figure 6.1c. It is 
implemented by using a shift register. 


Using these basic elements, we can now describe various structures of 


both IIR and FIR filters. MATLAB is a convenient tool in the develop- 
ment of these structures that require operations on polynomials. 


- = + xan) 
X(n) 


(a) Adder 
a Z 
x(n) @—> axin) x(n) @e—> x(n - 1) 
(b) Multiplier (c) Delay element 


FIGURE 6.1 Three basic elements 
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6.2 IIR FILTER STRUCTURES 
—————— ER 


The system function of an IIR filter is given by 


H(z) = B(z) = abart 2 bo + b127! EEE S buz ™. a 
A(z) eae Anz n 1 t az~! EE anz“ N » 40 
(6.1) 


where bn and a,, are the coefficients of the filter. We have assumed without 
loss of generality that a9 = 1. The order of such an IIR filter is called N if 
ay #0. The difference equation representation of an IIR filter is expressed 
as 


M N 
y(n) = 5 bm«(n — m) — 5 amy(n — m) (6.2) 
m=0 m=1 


Three different structures can be used to implement an IIR filter: 


1. Direct form: In this form the difference equation (6.2) is implemented 
directly as given. There are two parts to this filter, namely the moving 
average part and the recursive part (or equivalently, the numerator 
and denominator parts). Therefore this implementation leads to two 
versions: direct form I and direct form IT structures. 

2. Cascade form: In this form the system function H(z) in equation 
(6.1) is factored into smaller 2nd-order sections, called biquads. The 
system function is then represented as a product of these biquads. Each 
biquad is implemented in a direct form, and the entire system function 
is implemented as a cascade of biquad sections. 

3. Parallel form: This is similar to the cascade form, but after factor- 
ization, a partial fraction expansion is used to represent H(z) as a sum 
of smaller 2nd-order sections. Each section is again implemented in a 
direct form, and the entire system function is implemented as a parallel 
network of sections. 


We will briefly discuss these forms in this section. IIR filters are gen- 
erally described using the rational form version (or the direct form struc- 
ture) of the system function. Hence we will provide MATLAB functions for 
converting direct form structures to cascade and parallel form structures. 


6.2.1 DIRECT FORM 
As the name suggests, the difference equation (6.2) is implemented as 
given using delays, multipliers, and adders. For the purpose of illustration, 
let M = N =4. Then the difference equation is 
y(n) = box(n) + by a(n — 1) + b2z(n — 2) + bga(n — 3) + bga(n — 4) 
ayy(n — 1) — agy(n — 2) — agy(n — 3) — aay(n — 4) 
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x(n) y(n} 


FIGURE 6.2 Direct form I structure 


which can be implemented as shown in Figure 6.2. This block diagram is 
called direct form I structure. 

The direct form I structure implements each part of the rational 
function H(z) separately with a cascade connection between them. The 
numerator part is a tapped delay line followed by the denominator part, 
which is a feedback tapped delay line. Thus there are two separate delay 
lines in this structure, and hence it requires eight delay elements. We 
can reduce this delay element count or eliminate one delay line by inter- 
changing the order in which the two parts are connected in the cascade. 
Now the two delay lines are close to each other, connected by a unity 
gain branch. Therefore one delay line can be removed, and this reduction 
leads to a canonical structure called direct form IT structure, shown in 
Figure 6.3. It should be noted that both direct forms are equivalent from 
the input-output point of view. Internally, however, they have different 
signals. 


bo y(n) x(n) bo 


x(n) y(n) 


(a) Normal (b) Transposed 


FIGURE 6.3 Direct form II structure 
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6.2.2 TRANSPOSED STRUCTURE 
An equivalent structure to the direct form can be obtained using a pro- 
cedure called transposition. In this operation three steps are performed: 


1. All path arrow directions are reversed. 

2. All branch nodes are replaced by adder nodes, and all adder nodes are 
replaced by branch nodes. 

3. The input and output nodes are interchanged. 


The resulting structure is called the transposed direct form structure. The 
transposed direct form II structure is shown in Figure 6.3b. Problem P6.3 
explains this equivalent structure. 


6.2.3 MATLAB IMPLEMENTATION 
In MATLAB the direct form structure is described by two row vectors; 
b containing the {bn } coefficients and a containing the {an } coefficients. 
The filter function, which is discussed in Chapter 2, implements the 
transposed direct form II structure. 


6.2.4 CASCADE FORM 

In this form the system function H(z) is written as a product of 2nd-order 
sections with real coefficients. This is done by factoring the numerator and 
denominator polynomials into their respective roots and then combining 
either a complex conjugate root pair or any two real roots into 2nd-order 
polynomials. In the remainder of this chapter, we assume that N is an 
even integer. Then 


A(z) = 
(z) Ltayz-t+---+tanz-X 
tp begat pen E 
= bo 0 o 
L+ayz-!4+-+-+anz7N 


(6.3) 


where K is equal to x, and Bri, Bk,2, Axi, and Ak,2 are real numbers 
representing the coefficients of 2nd-order sections. The 2nd-order section 


Mpa): lt Bee + Bee k=1 


K 
Y;.(z) 1+ Ak 127! =f AÅk,227? , : f 


H(z) 


with 

Yı (z) = boX (2); Yx4i(z) = Y (2) 
is called the kth biquad section. The input to the kth biquad section is 
the output from the (k — 1)th biquad section, and the output from the 
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Vuln) = Xk+ (N) Ye 


FIGURE 6.4 Biquad section structure 


kth biquad is the input to the (k + 1)th biquad. Now each biquad section 
H(z) can be implemented in direct form II, as shown in Figure 6.4. The 
entire filter is then implemented as a cascade of biquads. 

As an example, consider N = 4. Figure 6.5 shows a cascade form 
structure for this 4th-order IIR filter. 


6.2.5 MATLAB IMPLEMENTATION 

Given the coefficients {bn} and {an} of the direct form filter, we have to 
obtain the coefficients bo, {Bi}, and {Ap i}. This is done by the following 
function dir2cas. 


function [b0,B,A] = dir2cas(b,a); 
% DIRECT-form to CASCADE-form conversion (cplxpair version) 


% [b0,B,A] = dir2cas(b,a) 
% bO = gain coefficient 


% B= K by 3 matrix of real coefficients containing bk’s 
% A= K by 3 matrix of real coefficients containing ak’s 
% b = numerator polynomial coefficients of DIRECT form 

% a = denominator polynomial coefficients of DIRECT form 


% compute gain coefficient bO 
bO = b(1); b = b/b0;' a0 = a(1); a = a/a0; bO = bO/a0; 


hh 
M = length(b); N = length(a) ; 
if NOM 


b = [b zeros(1,N-M)]; 


x(n) y(n} 


FIGURE 6.5 Cascade form structure for N = 4 
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elseif M > N 

a = [a zeros(1,M-N)]; N = M; 

else 

NM = 0; 

end 

7 

K = floor(N/2); B = zeros(K,3); A = zeros(K,3); 
if K*2 == N; 

b = [b 0]; a= [a 0]; 

end 

h 

broots = cplxpair(roots(b)); aroots = cplxpair(roots(a)); 
for i=1:2:2*K 


Brow = broots(i:1:iti1,:); Brow = real (poly (Brow) ) ; 
B(fix((it1)/2),:) = Brow; 

Arow = aroots(i:1:itl,:); Arow = real (poly (Arow)) ; 
A(fix((it1)/2),:) = Arow; 

end 


This function converts the b and a vectors into K x 3 B and A matrices. 
It begins by computing bo, which is equal to bo/ao (assuming ap Æ 1). 
It then makes the vectors b and a of equal length by zero-padding the 
shorter vector. This ensures that each biquad has a nonzero numerator 
and denominator. Next it computes the roots of the B(z) and A(z) poly- 
nomials. Using the cplxpair function, these roots are ordered in complex 
conjugate pairs. Now every pair is converted back into a 2nd-order numer- 
ator or denominator polynomial using the poly function. The SP toolbox 
function, tf2sos (transfer function to 2nd-order section), also performs 
a similar operation. 

The cascade form is implemented using the following casfiltr 
function. 


function y = casfiltr(b0,B,A,x); 
% CASCADE form realization of IIR and FIR filters 


% y = casfiltr(b0,B,A,x); 

% y = output sequence 

% bO = gain coefficient of CASCADE form 

% B= K by 3 matrix of real coefficients containing bk’s 


% A= K by 3 matrix of real coefficients containing ak’s 
% x = input sequence 
% 


[K,L] = size(B); 
N = length(x); w = zeros(K+1,N); w(1,:) = x; 
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Foree = abgaleie 

w(iti,:) = filter(B(i,:),ACGi,:),w(i,:)); 
end 
y = bO*w(K+1,:); 


It employs the filter function in a loop using the coefficients of 
each biquad stored in B and A matrices. The input is scaled by bO, 
and the output of each filter operation is used as an input to the next 
filter operation. The output of the final filter operation is the overall 
output. 

The following MATLAB function, cas2dir, converts a cascade form 
to a direct form. This is a simple operation that involves multiplication of 
several 2nd-order polynomials. For this purpose, the MATLAB function 
conv is used in a loop over K factors. The SP toolbox function, sos2tf 
also performs a similar operation. 


function [b,a] = cas2dir(b0,B,A); 
% CASCADE-to-DIRECT form conversion 


% [b,a] = cas2dir(b0,B,A) 

% b = numerator polynomial coefficients of DIRECT form 
% a = denominator polynomial coefficients of DIRECT form 
% bO = gain coefficient 

% B= K by 3 matrix of real coefficients containing bk’s 
% A= K by 3 matrix of real coefficients containing ak’s 


[K,L] = size(B); 

b = [1]; a= [1]; 

for i=1:1:K 

b=conv(b,B(i,:)); a=conv(a,A(i,:)); 
end 

b = b*b0; 


EXAMPLE 6.1 A filter is described by the following difference equation: 


16y(n) + 12y(n — 1) + 2y(n — 2) — 4y(n — 3) — y(n — 4) 
= g(n) — 3a(n — 1) + 11a(n — 2) — 27x(n — 3) + 182(n — 4) 


Determine its cascaded form structure. 
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Solution MATLAB script: 


>> b=[1 -3 11 -27 18]; a=[16 12 2 -4 -1]; 
>> [b0,B,A]=dir2cas(b,a) 

bO = 0.0625 

B 


1.0000 -0.0000 9.0000 
1.0000 -3.0000 2.0000 


1.0000 1.0000 0.5000 
1.0000 -0.2500 -0.1250 


The resulting structure is shown in Figure 6.6. To check that our cascade struc- 
ture is correct, let us compute the first 8 samples of the impulse response using 
both forms. 


>> delta = impseq(0,0,7) 
delta = 
1 0 0 0 0 0 0 0 
>> format long 
>> hcas=casfiltr(b0,B,A,delta) 
hcas = 
Columns 1 through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 
Columns 5 through 8 
2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 
>> hdir=filter(b,a,delta) 
hdir = 
Columns 1 through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 
Columns 5 through 8 
2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 


0.625 


x(n) y(n} 


FIGURE 6.6 Cascade structure in Example 6.1 
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6.2.6 PARALLEL FORM 
In this form the system function H(z) is written as a sum of 2nd-order 
sections using partial fraction expansion. 


H(z) B(z)  bo+biz™! +++ + byez! 
z) = = 
A(z) Ltayz-t+---+tanz 7X 
bo + bie et byat N So 
= zZ 
l1+aiz™! +- +anyz 7N - k 
N i 


— 
only if M>N 


K M-N 
Bpo + Briz 
=y BOER ite De (6.4) 
T 1+ AÁk,1z7! + AÅk,227? 5 
T —_ 
only if M>N 


where K is equal to x, and Bro, Bri, Ari, and Ak 2 are real num- 
bers representing the coefficients of 2nd-order sections. The 2nd-order 
section 
Y; B Braz 
H,(z2) = al) _ pen ie ; k=1,...,K 
Yp(z) 1+ Apk,127! + Apoz~? 
with 


Yez) = He(z)X(z), Y(2)=> Yr), M<N 


is the kth proper rational biquad section. The filter input is available to 
all biquad sections as well as to the polynomial section if M > N (which 
is an FIR part). The output from these sections is summed to form the 
filter output. Now each biquad section H(z) can be implemented in direct 
form II. Due to the summation of subsections, a parallel structure can be 
built to realize H(z). As an example, consider M = N = 4. Figure 6.7 
shows a parallel-form structure for this 4th-order IIR filter. 


6.2.7 MATLAB IMPLEMENTATION 
The following function dir2par converts the direct-form coefficients {bn } 
and {an} into parallel form coefficients {By} and {Axi}. 
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x(n) y(n} 


FIGURE 6.7 Parallel form structure for N = 4 


function [C,B,A] = dir2par (b,a); 
% DIRECT-form to PARALLEL-form conversion 


C,B,A] = dir2par (b,a) 

C = Polynomial part when length(b) >= length(a) 

% B= K by 2 matrix of real coefficients containing bk’s 
A = K by 3 matrix of real coefficients containing ak’s 
b = numerator polynomial coefficients of DIRECT form 
a = denominator polynomial coefficients of DIRECT form 


M = length(b); N = length(a) ; 


[r1,p1,C] = residuez(b,a) ; 
p = cplxpair(p1,10000000*eps); I = cplxcomp(pl,p); r = r1i(1); 


K = floor(N/2); B = zeros(K,2); A = zeros(K,3); 
if K*2 == N; %N even, order of A(z) odd, one factor is first order 
for i=1:2:N-2 

Brow = r(i:1:i+1,:); Arow = p(i:1:it1,:); 

[Brow,Arow] = residuez(Brow,Arow,[]); 

B(fix((it1i)/2),:) = real(Brow); A(fix((it1)/2),:) = real(Arow); 
end 

[Brow,Arow] = residuez(r(N-1),p(N-1),[]); 

B(K,:) = [real(Brow) 0]; A(K,:) = [real(Arow) 0]; 
else 
for i=1:2:N-1 
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Brow = r(i:1:it1,:); Arow = p(i:1:it1,:); 

[Brow,Arow] = residuez(Brow, Arow, []); 

B(fix((iti)/2),:) = real(Brow); A(fix((it1)/2),:) = real(Arow); 
end 

end 


The dir2cas function first computes the z-domain partial fraction expan- 
sion using the residuez function. We need to arrange pole-and-residue 
pairs into complex conjugate pole-and-residue pairs followed by real pole- 
and-residue pairs. To do this, the cplxpair function from MATLAB can 
be used; this sorts a complex array into complex conjugate pairs. How- 
ever, two consecutive calls to this function, one each for pole and residue 
arrays, will not guarantee that poles and residues will correspond to each 
other. Therefore a new cplxcomp function is developed, which compares 
two shuffled complex arrays and returns the index of one array, which can 
be used to rearrange another array. 


function I = cplxcomp(p1,p2) 
% I = cplxcomp(p1,p2) 
% Compares two complex pairs which contain the same scalar elements 
% but (possibly) at differrent indices. This routine should be 
% used after CPLXPAIR routine for rearranging pole vector and its 
% corresponding residue vector. 
h p2 = cplxpair(p1) 
% 
TeL 
for j=1:1:length(p2) 
for i=1:1:length(p1) 
if (abs(p1(i)-p2(j)) < 0.0001) 
I=[I,il; 
end 
end 
end 
I=T? ; 


After collecting these pole-and-residue pairs, the dir2cas function com- 
putes the numerator and denominator of the biquads by employing the 
residuez function in the reverse fashion. 

These parallel-form coefficients are then used in the function 
parfiltr, which implements the parallel form. The parfiltr function 
uses the filter function in a loop using the coefficients of each biquad 
stored in the B and A matrices. The input is first filtered through the FIR 
part C and stored in the first row of a w matrix. Then the outputs of all 
biquad filters are computed for the same input and stored as subsequent 
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rows in the w matrix. Finally, all the columns of the w matrix are summed 
to yield the output. 


function y = parfiltr(C,B,A,x); 
% PARALLEL form realization of IIR filters 


% [y] = parfiltr(C,B,A,x); 

y = output sequence 

C = polynomial (FIR) part when M >= N 

% B= K by 2 matrix of real coefficients containing bk’s 
A 
x 


K by 3 matrix of real coefficients containing ak’s 
input sequence 


[K,L] = size(B); N = length(x); w = zeros(K+1,N); 
w(1,:) = filter(C,1,x); 
for al = abgal ele 
w(iti,:) = filter(B(i,:),ACGi,:),x); 
end 
y = sum(w); 


To obtain a direct form from a parallel form, the function par2dir can 
be used. It computes poles and residues of each proper biquad and com- 
bines these into system poles and residues. Another call of the residuez 
function in reverse order computes the numerator and denominator 
polynomials. 


function [b,a] = par2dir(C,B,A); 
% PARALLEL-to-DIRECT form conversion 


% [b,a] = par2dir(C,B,A) 

% b = numerator polynomial coefficients of DIRECT form 
% a = denominator polynomial coefficients of DIRECT form 
% C = Polynomial part of PARALLEL form 

% B= K by 2 matrix of real coefficients containing bk’s 
% A= K by 3 matrix of real coefficients containing ak’s 
% 

oie] = siU R Mls a = (le 

for i=1:1:K 

[r,p,k]=residuez(B(i,:),AGi,:)); R = [R;r]; P = [P;pl; 
end 


[b,a] = residuez(R,P,C); b = b(:)’; a = a(:)’; 
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EXAMPLE 6.2 Consider the filter given in Example 6.1. 


16y(n) + 12y(n — 1) + 2y(n — 2) — 4y(n — 3) — y(n — 4) 
= g(n) — 3a(n — 1) + 11a(n — 2) — 27x(n — 3) + 182(n — 4) 


Now determine its parallel form. 


Solution MATLAB script: 


>> b=[1 -3 11 -27 18]; a=[16 12 2 -4 -1]; 
>> [C,B,A]=dir2par(b,a) 
Cc) = 
-18 
B= 
10.0500 -3.9500 
28.1125 -13.3625 
i = 
1.0000 1.0000 0.5000 
1.0000 -0.2500 -0.1250 


The resulting structure is shown in Figure 6.8. To check our parallel structure, 
let us compute the first 8 samples of the impulse response using both forms. 


>> format long; delta = impseq(0,0,7); hpar=parfiltr(C,B,A,delta) 
hpar = 
Columns 1 through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 


x(n) y(n} 


FIGURE 6.8 Parallel form structure in Example 6.2 
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Columns 5 through 8 
2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 
>> hdir = filter(b,a,delta) 
hdir = 
Columns 1 through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 
Columns 5 through 8 
2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 


EXAMPLE 6.3 What would be the overall direct, cascade, or parallel form if a structure contains 
a combination of these forms? Consider the block diagram shown in Figure 6.9. 


Solution This structure contains a cascade of two parallel sections. The first parallel 
section contains 2 biquads, while the second one contains 3 biquads. We will have 
to convert each parallel section into a direct form using the par2dir function, 
giving us a cascade of 2 direct forms. The overall direct form can be computed 
by convolving the corresponding numerator and denominator polynomials. The 
overall cascade and parallel forms can now be derived from the direct form. 


MATLAB script: 


>> CO=0; B1=[2 4;3 1]; A1=[1 1 0.9; 1 0.4 -0.4]; 
>> B2=[0.5 0.7;1.5 2.5;0.8 1]; A2=[1 -1 0.8;1 0.5 0.5;1 0 -0.5]; 
>> [b1,a1]=par2dir(CO,B1,A1) 
bi = 
5.0000 8.8000 4.5000 -0.7000 


x(n) y(n} 


FIGURE 6.9 Block diagram in Example 6.3 
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al = 
1.0000 1.4000 0.9000 -0.0400 -0.3600 
>> [b2,a2]=par2dir(CO,B2,A2) 
b2 = 
2.8000 2.5500 -1.5600 2.0950 0.5700 -0.7750 
a2 = 
1.0000 -0.5000 0.3000 0.1500 0.0000 0.0500 -0.2000 
>> b=conv(b1,b2) % Overall direct form numerator 
b= 
Columns 1 through 7 
14.0000 37.3900 27.2400 6.2620 12.4810 11.6605 -5.7215 
Columns 8 through 9 
-3.8865 0.5425 
>> a=conv(ai,a2) % Overall direct form denominator 
a= 
Columns 1 through 7 
1.0000 0.9000 0.5000 0.0800 0.1400 0.3530 -0.2440 
Columns 8 through 11 
-0.2890 -0.1820 -0.0100 0.0720 
>> [b0,Bc,Ac]=dir2cas(b,a) % Overall cascade form 


bO = 
14.0000 
Re = 
1.0000 1.8836 1.1328 
1.0000 -0.6915 0.6719 
1.0000 2.0776 0.8666 
1.0000 0 0 
1.0000 -0.5990 0.0588 
Ne = 
1.0000 1.0000 0.9000 
1.0000 0.5000 0.5000 
1.0000 -1.0000 0.8000 
1.0000 1.5704 0.6105 
1.0000 -1.1704 0.3276 
>> [CO,Bp,Ap]=dir2par(b,a) % Overall parallel form 
co = [] 
Bp = 
-20.4201 -1.6000 
24.1602 5.1448 
2.4570 3.3774 
-0.8101 -0.2382 
8.6129 -4.0439 
Ap = 


. 0000 1.0000 0.9000 
. 0000 0.5000 0.5000 
. 0000 -1.0000 0.8000 
. 0000 1.5704 0.6105 
. 0000 -1.1704 0.3276 


e.rerrere 
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This example shows that by using the MATLAB functions developed in this 
section, we can probe and construct a wide variety of structures. 


6.3 FIR FILTER STRUCTURES 
SS gp 


A finite-duration impulse response filter has a system function of the form 
M-1 

H(z) = bo tbe} +--+ by_i21™ = 5 bnz” (6.5) 
n=0 


Hence the impulse response h(n) is 


nn) = So 0<n<M-1 (6.6) 


~ 0, else 
and the difference equation representation is 
y(n) = boa(n) + bya(n — 1) +--+ + by_-i1a(n — M +1) (6.7) 


which is a linear convolution of finite support. 

The order of the filter is M — 1, and the length of the filter (which 
is equal to the number of coefficients) is M. The FIR filter structures are 
always stable, and they are relatively simple compared to IIR structures. 
Furthermore, FIR filters can be designed to have a linear-phase response, 
which is desirable in some applications. 

We will consider the following four structures: 


1. Direct form: In this form the difference equation (6.7) is implemented 
directly as given. 

2. Cascade form: In this form the system function H(z) in (6.5) is fac- 
tored into 2nd-order factors, which are then implemented in a cascade 
connection. 

3. Linear-phase form: When an FIR filter has a linear-phase response, 
its impulse response exhibits certain symmetry conditions. In this form 
we exploit these symmetry relations to reduce multiplications by about 
half. 

4. Frequency-sampling form: This structure is based on the DFT of 
the impulse response h(n) and leads to a parallel structure. It is also 
suitable for a design technique based on the sampling of frequency 
response H(e?”). 


We will briefly describe these four forms along with some examples. 
The MATLAB function dir2cas developed in the previous section is also 
applicable for the cascade form. 
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x(n) 


y(n} 
FIGURE 6.10 Direct form FIR structure 


6.3.1 DIRECT FORM 
The difference equation (6.7) is implemented as a tapped delay line since 
there are no feedback paths. Let M = 5 (i.e., a 4th-order FIR filter); then 


y(n) = box(n) + bya(n — 1) + b2z(n — 2) + bsx (n — 3) + baa(n — 4) 


The direct form structure is given in Figure 6.10. Note that since the 
denominator is equal to unity, there is only one direct form structure. 


6.3.2 MATLAB IMPLEMENTATION 

In MATLAB the direct form FIR structure is described by the row vector 
b containing the {bn} coefficients. The structure is implemented by the 
filter function, in which the vector a is set to the scalar value 1, as 
discussed in Chapter 2. 


6.3.3 CASCADE FORM 

This form is similar to that of the IIR form. The system function H(z) is 
converted into products of 2nd-order sections with real coefficients. These 
sections are implemented in direct form and the entire filter as a cascade 
of 2nd-order sections. From (6.5) 


H(z) = bo + b127" +- + bm127 t (6.8) 
bi a bM-1 -M+ 
=b(14 Ee 
bo ( w i Zz 
K 


= bo II (1 + Beas + Bp 227°) 
k=1 


where K is equal to |# |, and By, and Bp, are real numbers representing 
the coefficients of 2nd-order sections. For M = 7 the cascade form is shown 
in Figure 6.11. 


x(n) y(n} 


FIGURE 6.11 Cascade form FIR structure 
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6.3.4 MATLAB IMPLEMENTATION 

Although it is possible to develop a new MATLAB function for the FIR 
cascade form, we will use our dir2cas function by setting the denominator 
vector a equal to 1. Similarly, cas2dir can be used to obtain the direct 
form from the cascade form. 


6.3.5 LINEAR-PHASE FORM 
For frequency-selective filters (e.g., lowpass filters) it is generally desirable 
to have a phase response that is a linear function of frequency; that is, we 
want 

LH(e®®) = 8- aw, —-t<w<t (6.9) 


where 3 = 0 or +7/2 and a is a constant. For a causal FIR filter with 
impulse response over [0, M — 1] interval, the linear-phase condition (6.9) 
imposes the following symmetry conditions on the impulse response h(n) 
(see Problem P6.16): 


h(n) = h(M -1 - n); p=0,a= 4, 0<n<M-1 (6.10) 


h(n) = -—h(M-1-n); B= r/2,a = “l 0Sn<M-1 (6.11) 


An impulse response that satisfies (6.10) is called a symmetric impulse 
response, and that in (6.11) is called an antisymmetric impulse response. 
These symmetry conditions can now be exploited in a structure called the 
linear-phase form. 

Consider the difference equation given in (6.7) with a symmetric im- 
pulse response in (6.10). We have 


y(n) = boz(n) + biz(n — 1) +--+ + biz(n— M + 2) + box(n — M +1) 
= bo[a(n) + a(n — M + 1)| + bi [a(n — 1)+ a(n- M +2] +- 


The block diagram implementation of these difference equation is shown 
in Figure 6.12 for both odd and even M. 

Clearly, this structure requires 50% fewer multiplications than the di- 
rect form. A similar structure can be derived for an antisymmetric impulse 
response. 


6.3.6 MATLAB IMPLEMENTATION 

The linear-phase structure is essentially a direct form drawn differently 
to save on multiplications. Hence in a MATLAB representation of the 
linear-phase structure is equivalent to the direct form. 
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x(n) gI za x(n) z71 z 


M=7 M=6 


FIGURE 6.12 Linear-phase form FIR structures (symmetric impulse response) 


EXAMPLE 6.4 An FIR filter is given by the system function 


1 
H(z) =1+16—2 442 
16 
Determine and draw the direct, linear-phase, and cascade form structures. 
a. Direct form: The difference equation is given by 
y(n) = x(n) + 16.06252(n — 4) + x(n — 8) 


and the direct form structure is shown in Figure 6.13(a). 
b. Linear-phase form: The difference equation can be written in the form 


y(n) = [a(n) + x(n — 8)] + 16.06252(n — 4) 


and the resulting structure is shown in Figure 6.13b. 
c. Cascade form: We use the following MATLAB Script. 


>> b=[1,0,0,0,16+1/16,0,0,0,1]; [b0,B,A] = dir2cas(b,1) 


x(n) 


z 4 
74 27-4 


y(n) y(n} 
(a) Direct Form (b) Linear-phase Form 


x(n) y(n} 


(c) Cascade Form 


FIGURE 6.13 FIR filter structures in Example 6.4 
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bO = 1 

B= 
1.0000 2.8284 4.0000 
1.0000 0.7071 0.2500 
1.0000 -0.7071 0.2500 
1.0000 -2.8284 4.0000 

A= 


ererre 
SS OS 
OO O0 


The cascade form structure is shown in Figure 6.13c. 


EXAMPLE 6.5 For the filter in Example 6.4, what would be the structure if we desire a cascade 
form containing linear-phase components with real coefficients? 


Solution We are interested in cascade sections that have symmetry and real coefficients. 
From the properties of linear-phase FIR filters (see Chapter 7), if such a filter 
has an arbitrary zero at z = rZ6, then there must be 3 other zeros at (1/r)Z6, 
rZ — 8, and (1/r)Z — 0 to have real filter coefficients. We can now make use of 
this property. First we will determine the zero locations of the given 8th-order 
polynomial. Then we will group 4 zeros that satisfy this property to obtain 
one (4th-order) linear-phase section. There are two such sections, which we will 
connect in cascade. 


MATLAB script: 


>> b=[1,0,0,0,16+1/16,0,0,0,1]; broots=roots (b) 


broots = 
-1.4142 + 1.4142i 
-1.4142 - 1.4142i 
1.4142 + 1.4142i 
1.4142 - 1.4142i 
-0.3536 + 0.35361 
-0.3536 - 0.35361 
0.3536 + 0.3536i 


0.3536 - 0.35361 
>> B1=real(poly([broots(1) ,broots(2) ,broots(5) ,broots(6)])) 
Bi = 
1.0000 375355 6.2500 3976355 1.0000 
>> B2=real (poly ([broots (3) ,broots(4) ,broots(7) ,broots(8)])) 
B2 = 
1.0000 735355 6.2500 =73153595 1.0000 


The structure is shown in Figure 6.14. 
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x(n) 


yin} 
FIGURE 6.14 Cascade of FIR linear-phase elements 


6.3.7 FREQUENCY SAMPLING FORM 

In this form we use the fact that the system function H (z) of an FIR 
filter can be reconstructed from its samples on the unit circle. From our 
discussions on the DFT in Chapter 5, we recall that these samples are 
in fact the M-point DFT values {H (k), 0 < k < M — 1} of the M-point 
impulse response h (n). Therefore we have 


H (z) = Z [h(n)| = Z [IDFT {H (k) y] 


Using this procedure, we obtain [see (5.17) in Chapter 5] 


o1- \ $ H(k) 
H(z) = =) 2 I Wor (6.12) 


This shows that the DFT H (k), rather than the impulse response 
h (n) (or the difference equation), is used in this structure. Also note that 
the FIR filter described by (6.12) has a recursive form similar to an IIR 
filter because (6.12) contains both poles and zeros. The resulting filter is 
an FIR filter since the poles at Wir are canceled by the roots of 


1-2“ =0 


The system function in (6.12) leads to a parallel structure, as shown in 
Figure 6.15 for M = 4. 

One problem with the structure in Figure 6.15 is that it requires a 
complex arithmetic implementation. Since an FIR filter is almost always a 
real-valued filter, it is possible to obtain an alternate realization in which 
only real arithmetic is used. This realization is derived using the symmetry 
properties of the DFT and the W;,* factor. Then (6.12) can be expressed 
as (see Problem P6.19) 


=M ee 
ats) =" {your (+ 20 wA) (6.13) 
k=1 
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y(n} 


FIGURE 6.15 Frequency sampling structure for M = 4 


where L = Gt for M odd, L = M — 1 for M even, and {H}; (z), k=1, 
...,L} are 2nd-order sections given by 


_ cos [ZH (k)] — z7! cos [ZH (k) — 224] 
7 1 — 227! cos (2E) + 27? 


Hy, (2) (6.14) 


Note that the DFT samples H (0) and H (M/2) are real-valued and that 
the third term on the right-hand side of (6.13) is absent if M is odd. Using 
(6.13) and (6.14), we show a frequency sampling structure in Figure 6.16 
for M = 4 containing real coefficients. 


cos[ZH(1)]  2{H(1)| 


yin} 


FIGURE 6.16 Frequency sampling structure for M = 4 with real coefficients 
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6.3.8 MATLAB IMPLEMENTATION 

Given the impulse response h (n) or the DFT H(k), we have to determine 
the coefficients in (6.13) and (6.14). The following MATLAB function, 
dir2fs, converts a direct form [h(n) values] to the frequency sampling 
form by directly implementing (6.13) and (6.14). 


function [C,B,A] = dir2fs(h) 
% Direct form to Frequency Sampling form conversion 


% [C,B,A] = dir2fs (h) 

% C = Row vector containing gains for parallel sections 

B = Matrix containing numerator coefficients arranged in rows 

% A = Matrix containing denominator coefficients arranged in rows 
h = impulse response vector of an FIR filter 


M = length(h); H = fft(h,M); 
magH = abs(H); phaH = angle(H)’; 
% check even or odd M 

if (M == 2*floor(M/2)) 


L = M/2-1; %M is even 

A1 = [1,-1,0;1,1,0]; C1 = [real(H(1)),real(H(L+2))]; 
else 

L = (M-1)/2; % M is odd 

Al = [1,-1,0]; C1 = [real(H(1))]; 
end 
KESAEN; 


% initialize B and A arrays 

B = zeros(L,2); A = ones(L,3); 

% compute denominator coefficients 
A(1:L,2) = -2*cos(2*pixk/M); A = [A;A1]; 
% compute numerator coefficients 
B(1:L,1) = cos(phaH(2:L+1)); 

B(1:L,2) = -cos(phaH(2:L+1)-(2*pi*k/M) ) ; 
% compute gain coefficients 

C = [2*magH(2:L+1) ,C1]’; 


In this function, the impulse response values are supplied through the 
h array. After conversion, the C array contains the gain values for each 
parallel section. The gain values for the 2nd-order parallel sections are 
given first, followed by H (0) and H (M/2) (if M is even). The B matrix 
contains the numerator coefficients, which are arranged in length-2 row 
vectors for each 2nd-order section. The A matrix contains the denominator 
coefficients, which are arranged in length-3 row vectors for the 2nd-order 
sections corresponding to those in B, followed by the coefficients for the 
1st-order sections. 
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A practical problem with the structure in Figure 6.16 is that it has 
poles on the unit circle, which makes this filter critically unstable. If the 
filter is not excited by one of the pole frequencies, then the output is 
bounded. We can avoid this problem by sampling H (z) on a circle |z| = r, 
where the radius r is very close to 1 but is less than 1 (e.g., r = 0.99), 
which results in 


H(z)= 5 Gat (re) 
(6.15) 
Now approximating H (re??"*/M) ~ H (e??**/M) for r æ 1, we can obtain 


a stable structure similar to the one in Figure 6.16 containing real values. 
This is explored in Problem P6.20. 


EXAMPLE 6.6 Let h(n) = s{1, 2,3,2,1}. Determine and draw the frequency sampling form. 
T 


Solution MATLAB script: 


>> h = [1,2,3,2,1]/9; [C,B,A] = dir2fs(h) 


C= 
0.5818 
0.0849 
1.0000 
B= 
-0.8090 0.8090 
0.3090 -0.3090 
A= 


1.0000 -0.6180 1.0000 
1.0000 1.6180 1.0000 
1.0000 -1.0000 0) 


Since M = 5 is odd, there is only one Ist-order section. Hence 


Loi? —0.809 + 0.80927! 
H(z) = ——— [0.581 
E) 5 0.5818- p6Isz tone 
= —1 
n: 0.309 — 0.309z | 1 


1+ 1.61827! + 272 


The frequency-sampling form is shown in Figure 6.17. 
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—0.809 0.5818 


0.309 


0.0848 


x(n) y(n} 


FIGURE 6.17 Frequency sampling structure in Example 6.6 


EXAMPLE 6.7 ‘The frequency samples of a 32-point linear-phase FIR filter are given by 


1, k=0,1,2 
|H (k)| = 4 0.5, k=3 
0, k=4,5,...,15 


Determine its frequency sampling form, and compare its computational com- 
plexity with the linear-phase form. 


Solution In this example since the samples of the DFT H (k) are given, we could use 
(6.13) and (6.14) directly to determine the structure. However, we will use the 
dir2fs function for which we will have to determine the impulse response h (n). 
Using the symmetry property and the linear-phase constraint, we assemble the 
DFT H (k) as 


|H (k)| = |H(32—k)|, k=1,2,...,31; H(0)=1 


Now the IDFT of H (k) will result in the desired impulse response. 


MATLAB script: 


>> M = 32; alpha = (M-1)/2; 

>> magHk = [1,1,1,0.5,zeros(1,25),0.5,1,1]; 

>> ki = 0:15; k2 = 16:M-1; 

>> angHk = [-alpha*(2*pi)/M*k1, alpha*(2*pi) /M*(M-k2)]; 

>> H = magHk.*exp(j*angHk); h = real(ifft(H,M)); [C,B,A] = dir2fs(h) 
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© 5 
2.0000 
2.0000 
1.0000 
0.0000 
0.0000 
0.0000 
0.0000 
0 
0.0000 
0.0000 
0.0000 
0.0000 
0.0000 
0.0000 
0.0000 
1.0000 
0 
B= 
-0.9952 0.9952 
0.9808 -0.9808 
-0.9569 0.9569 
-0.8944 0.3162 
0.9794 -0.7121 
0.8265 0.2038 
-0.6754 0.8551 
1.0000 0.0000 
0.6866 -0.5792 
0.5191 0.9883 
-0.4430 0.4993 
-0.8944 -0.3162 
-0.2766 0.3039 
0.9343 0.9996 
-0.9077 -0.8084 
A= 
1.0000 -1.9616 1.0000 
1.0000 -1.8478 1.0000 
1.0000 -1.6629 1.0000 
1.0000 -1.4142 1.0000 
1.0000 ila alalilal 1.0000 
1.0000 -0.7654 1.0000 
1.0000 -0.3902 1.0000 
1.0000 0.0000 1.0000 
1.0000 0.3902 1.0000 
1.0000 0.7654 1.0000 
1.0000 1.1111 1.0000 
1.0000 1.4142 1.0000 
1.0000 1.6629 1.0000 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eC hapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Lattice Filter Structures 239 


1.0000 1.8478 1.0000 
1.0000 1.9616 1.0000 
1.0000 -1.0000 0 
1.0000 1.0000 0 


Note that only 4 gain coefficients are nonzero. Hence the frequency sampling 
form is 


—0.9952 + 0.995227! 90.9808 = 0.980827! 
_ 1—7? | “1 -1.96162-1 + 2-2 * 1— 1.84782-1 + 2-2 | 
32 —0.9569 + 0.956927" 1 
1 — 1.6629z-1 + z272 1—z7! 


To determine the computational complexity, note that since H (0) = 1, the 1st- 
order section requires no multiplication, whereas the three 2nd-order sections 
require 3 multiplications each for a total of 9 multiplications per output sample. 
The total number of additions is 13. To implement the linear-phase structure 
would require 16 multiplications and 31 additions per output sample. Therefore 
the frequency sampling structure of this FIR filter is more efficient than the 
linear-phase structure. 


6.4 LATTICE FILTER STRUCTURES 
—— g 


The lattice filter is extensively used in digital speech processing and in 
the implementation of adaptive filters. It is a preferred form of realization 
over other FIR or IIR filter structures because in speech analysis and in 
speech synthesis the small number of coefficients allows a large number of 
formants to be modeled in real time. The all-zero lattice is the FIR filter 
representation of the lattice filter, while the lattice ladder is the IIR filter 
representation. 


6.4.1 ALL-ZERO LATTICE FILTERS 

An FIR filter of length M (or order M — 1) has a lattice structure with 
M —1 stages as shown in Figure 6.18. Each stage of the filter has an input 
and output that are related by the order-recursive equations [23]: 


fmn) = fm- (n) + Kmgm—-1(n - 1), m=1,2,..., M —1 


(6.16) 

gm(n) = Kmfm-1(n) + gm-1(n —- 1), m=1,2,...,M —1 
where the parameters Km, m = 1,2,..., M — 1, called the reflection 
coefficients, are the lattice filter coefficients. If the initial values of fm(n) 
and gm(m) are both the scaled value (scaled by Ko) of the filter input 
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fmin) 


Ku y(n} 


FIGURE 6.18 All-zero lattice filter 


x(n), then the output of the (M — 1) stage lattice filter corresponds to 
the output of an (M — 1) order FIR filter; that is, 


fo(r) = go(n) = Kox(n) 
y(n) = f—1(n) 
If the FIR filter is given by the direct form 


M-1 M-1 
H(z) = X. bag = bo (: +> zae) (6.18) 


and if we denote the polynomial Ajyy_1(z) by 


(6.17) 


M-1 
Am-1(z) = (: +> carne") (6.19) 
m=1 
bm 
am—i(m) = —,m=1,...,M-1 
bo 


then the lattice filter coefficients {Km } can be obtained by the following 
recursive algorithm [23]: 


Ko = bo 
Ku-1 = am-1(M — 1) 
Le A (er ys m=M-—1,...,1 (6.20) 
Aga (2) = eee ceed en) a ee 
Km = Qm(m), m= M-—2,...,1 


Note that this algorithm will fail if |Km| = 1 for any m = 1,...,M — 1. 
Clearly, this condition is satisfied by linear-phase FIR filters since 


bu-1 


=1 
bo 


bea ipl yay = | 
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Therefore, linear-phase FIR filters cannot be implemented using lattice 
structures. 


6.4.2 MATLAB IMPLEMENTATION 

Given the coefficients {bn } of the direct form, we can obtain the lattice fil- 
ter coefficients {Km } using (6.20). This is done by the following MATLAB 
function dir2latc. Note that the equation to compute J,,(z) implies that 
the polynomial J,,(z) is a fliplr operation on the A,,(z) polynomial. 


function [K] = dir2latc(b) 
% FIR Direct form to All-Zero Lattice form Conversion 


% [K] = dir2latc(b) 
% K = Lattice filter coefficients (reflection coefficients) 
% b= FIR direct form coefficients (impulse response) 


M = length(b); K = zeros(1,M); bi = b(1); 
if bi == 

error(’b(1) is equal to zero’) 

end 

K(1) = b1; A = b/b1; 

for m=M:-1:2 

K(m) = A(m); J = fliplr(A); 

A = (A-K(m)*J)/(1-K(m)*K(m)); A = A(1:m-1); 
end 


The lattice filter is implemented using (6.16) and (6.17), which is done by 
a latcfilt function, as shown here. 


function [y] = latcfilt(K,x) 
% LATTICE form realization of FIR filters 


% y = latcfilt(K,x) 

output sequence 

LATTICE filter (reflection) coefficient array 
input sequence 


os 
a AS 
Il 


Nx = length(x)-1; x = K(1)*x; 
M = length(K)-1; K = K(2:M+1); fg = [x; [0 x(1:Nx)]]; 
for m = 1:M 

fg = [1,K(m);K(m),1]*fg; 

fg(2,:) = [0 fg(2,1:Nx)]; 


y = fg(1,:); 
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The equations (6.20) can also be used to determine the direct, form 
coefficients {bm } from the lattice filter coefficients {Km } using a recursive 
procedure [22]: 


Jml) = 2 T Am le) m=1,2,...,M —1 


bm = Koam-ı(m), m=0,1,..., M —1 


The following MATLAB function latc2dir implements (6.21). Note 
that the product K,,2~'Jm_—1(z) is obtained by convolving the 2 corre- 
sponding arrays, whereas the polynomial J,,(z) is obtained by using a 
fliplr operation on the A,,(z) polynomial. 


function [b] = latc2dir(K) 
% All-Zero Lattice form to FIR Direct form Conversion 


% [b] = latc2dir(K) 
% b= FIR direct form coefficients (impulse response) 
% K = Lattice filter coefficients (reflection coefficients) 


M = length(K); J= 1; A= 1; 

for m=2:1:M 

A = [A,0]+conv([0,K(m)], J); J = fliplr(A); 
end 

b=A*K (1) ; 


EXAMPLE 6.8 An FIR filter is given by the difference equation 


a(n — 2) + 


AI 


y(n) = 2a(n) 4 gt 1) + 


Determine its lattice form. 


Solution MATLAB script: 


>> b=[2, 13/12, 5/4, 2/3]; K=dir2latc(b) 
K= 
2.0000 0.2500 0.5000 0.3333 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Lattice Filter Structures 243 


x(n) 


y(n) 


(b) 
FIGURE 6.19 FIR filter structures in Example 6.8: (a) direct form (b) lattice 
form 
Hence 
1 1 1 
Ko =2, Kı Ke K3 


The direct form and the lattice form structures are shown in Figure 6.19. To 
check that our lattice structure is correct, let us compute the impulse response 
of the filter using both forms. 


>> [x,n] = impseq(0,0,3]; format long hdirect=filter(b,1,delta) 
hdirect = 
2.00000000000000 1.08333333333333 1.25000000000000 0.66666666666667 
>> hlattice=latcfilt(K,delta) 
hlattice = 
2.00000000000000 1.08333333333333 1.25000000000000 0.66666666666667 


6.4.3 ALL-POLE LATTICE FILTERS 

A lattice structure for an IIR filter is restricted to an all-pole system 
function. It can be developed from an FIR lattice structure. Let an all- 
pole system function be given by 


H(z) = (6.22) 


m=1 


which from (6.19) is equal to H(z) = 1/An(z). Clearly, it is an inverse sys- 
tem to the FIR lattice of Figure 6.18 (except for factor 69). This IIR filter 
of order N has a lattice structure with N stages, as shown in Figure 6.20. 
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x(n) = fiy(n) fry 4(n) hin) f,(n) fo(n) 


A D 7 
Ky K2 
EY y(n} 


gnin) gn-1(n) gln) gı(n) Hin) 
FIGURE 6.20 All-pole lattice filter 


Each stage of the filter has an input and output that are related by the 
order-recursive equations [23]: 


) 

) = fm (n) — Kmgm-1 (n — 1), m= N, N-1,...,1 
(6.23) 
gm(2) = Kmfm-1(n) + gm-1(n- 1), m=N, N—1,...,1 

) 


where the parameters Km, m = 1,2,..., M — 1, are the reflection coeffi- 
cients of the all-pole lattice and are obtained from (6.20) except for Ko, 
which is equal to 1. 


6.4.4 MATLAB IMPLEMENTATION 

Since the IIR lattice coefficients are derived from the same (6.20) proce- 
dure used for an FIR lattice filter, we can use the dir2latc function in 
MATLAB. Care must be taken to ignore the Ko coefficient in the K array. 
Similarly, the latc2dir function can be used to convert the lattice {Km } 
coefficients into the direct form {ay(m)}, provided that Ko = 1 is used 
as the first element of the K array. The implementation of an IIR lattice 
is given by (6.23), and we will discuss it in the next section. 


EXAMPLE 6.9 Consider an all-pole IIR filter given by 


Determine its lattice structure. 
Solution MATLAB script: 
>> a=[1, 13/24, 5/8, 1/3]; K=dir2latc(a) 


K= 
1.0000 0.2500 0.5000 0.3333 
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1 1 1 


Zz Zz Zz 


y(n) 


(a) 


“KT ATOR 
Pz PN oz PN 


x(n) 


y(n} 
(b) 
FIGURE 6.21 JIR filter structures in Example 6.9: (a) direct form (b) lattice 
form 
Hence 
we, Ka=5, and rome 


The direct form and the lattice form structures of this IIR filter are shown in 
Figure 6.21. 


6.4.5 LATTICE-LADDER FILTERS 

A general IIR filter containing both poles and zeros can be realized as 
a lattice-type structure by using an all-pole lattice as the basic building 
block. Consider an IIR filter with system function 


(k) =" 


H(z) = = (6.24) 


M 
5 bu zZ 
k=0 
N 
1+ 5 an(k)z—* 
k=1 
where, without loss of generality, we assume that N > M. A lattice- 
type structure can be constructed by first realizing an all-pole lattice 
with coefficients Km, 1 < m < N for the denominator of (6.24), and 
then adding a ladder part by taking the output as a weighted linear 
combination of {gm(n)}, as shown in Figure 6.22 for M = N. The result 
is a pole-zero IIR filter that has the lattice-ladder structure. Its output is 
given by 


M 
y(n) = X` Cngm(n) (6.25) 
m=0 
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x(n) = fyi) fy- (n) hin) fin) fin) 


FIGURE 6.22 Lattice-ladder structure for realizing a pole-zero IIR filter 


where {Cm } are called the ladder coefficients that determine the zeros of 
the system function H(z). It can be shown [23] that {Cm } are given by 


Bue) = X. CmJm(2) (6.26) 


where Jm(z) is the polynomial in (6.20). From (6.26) one can obtain a 
recursive relation 


Bn(z) = Bm-1(2) + CmJm(z2); m= 1,2,...,M 


or equivalently, 


(am 


M 
Cm = bm + 5 Ciaili—- m); m=M, M-1,..., (6.27) 


i=m+1 


from the definitions of Bm(z) and Am(2). 


6.4.6 MATLAB IMPLEMENTATION 

To obtain a lattice-ladder structure for a general rational IIR filter, we 
can first obtain the lattice coefficients {Km} from Ayn(z) using the re- 
cursion (6.20). Then we can solve (6.27) recursively for the ladder coeffi- 
cients {Cm} to realize the numerator Bm (2z). This is done in the following 
MATLAB function dir2ladr. It can also be used to determine the all-pole 
lattice parameters when the array b is set to b=[1]. 
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function [K,C] = dir2ladr(b,a) 
% IIR Direct form to pole-zero Lattice/Ladder form Conversion 


a ea pee eee 
% [K,C] = dir2ladr (b,a) 

% K = Lattice coefficients (reflection coefficients), [Ki,...,KN] 
% C = Ladder Coefficients, [CO,...,CN] 

% b = Numerator polynomial coefficients (deg <= Num deg) 

% a = Denominator polynomial coefficients 


al = a(1); a = a/ai; b = b/al; 
M = length(b); N = length(a); 
if M>N 
error(’? %*** length of b must be <= length of a ***’) 


b = [b, zeros(1,N-M)]; K = zeros(1,N-1); 
A = zeros(N-1,N-1); C = b; 
for m = N-1:-1:1 
A(m,i:m) = -a(2:m+1)*C(m+1) ; 
K(m) = a(m+1); J = fliplr(a); 
a = (a-K(m)*J)/(1-K(m)*K(m)); a = a(1:m); 
C(m) = b(m) + sum(diag(A@m:N-1,1:N-m))); 
end 


Note: To use this function, N > M. If M > N, the numerator Ay (z) 
should be divided into the denominator Bm(z) using the deconv func- 
tion to obtain a proper rational part and a polynomial part. The proper 
rational part can be implemented using a lattice-ladder structure, while 
the polynomial part is implemented using a direct structure. 

To convert a lattice-ladder form into a direct form, we first use the 
recursive procedure in (6.21) on {Km} coefficients to determine {ay (k)} 
and then solve (6.27) recursively to obtain {b,;(k)}. This is done in the 
following MATLAB function ladr2dir. 


function [b,a] = ladr2dir(K,C) 
% Lattice/Ladder form to IIR Direct form Conversion 


cE 
% [b,a] = ladr2dir(K,C) 

% b = numerator polynomial coefficients 

% a = denominator polymonial coefficients 

% K = Lattice coefficients (reflection coefficients) 
% C = Ladder coefficients 

hh 

N = length(K); M = length(C); 

C = [C, zeros(1,N-M+1)]; 
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J= 1; a= 1; A = zeros(N,N); 
for m=1:1:N 

a = [a,0]+conv([0,K(m)],J); 

A(m,i:m) = -a(2:m+1); J = fliplr(a); 
end 
b(N+1) = C(N+1); 
Torem = Ne cT 

A(m,1:m) = A(m,1:m)*C(m+1); 

b(m) = C(m) - sum(diag(A(m:N,1:N-m+1))); 
end 


The lattice-ladder filter is implemented using (6.23) and (6.25). 
This is done in the following MATLAB function ladrfilt. It should 
be noted that, due to the recursive nature of this implementation along 
with the feedback loops, this MATLAB function is neither an elegant 
nor an efficient method of implementation. It is not possible to exploit 
MATLAB’s inherent parallel processing capabilities in implementing this 
lattice-ladder structure. 


function [y] = ladrfilt(K,C,x) 
ù% LATTICE/LADDER form realization of IIR filters 


% [y] = ladrfilt(K,C,x) 
y = output sequence 
% K = LATTICE (reflection) coefficient array 
C = LADDER coefficient array 
x input sequence 


Nx = length(x); y = zeros(1,Nx); 
N = length(C); f = zeros(N,Nx); g = zeros(N,Nx+1) ; 
f(N,:) = x; 
for n = 2:1:Nxti 
for m = N:-1:2 
f(m-1,n-1) = f(m,n-1) - K(m-1)*g(m-1,n-1); 
g(m,n) = K(m-1)*f(m-1,n-1) + g(m-1,n-1); 
end 
g(1,n) = f(1,n-1); 
end 
y = Cxg(: ,2:Nx+1) ; 


EXAMPLE 6.10 Convert the following pole-zero IIR filter into a lattice-ladder structure. 


_ 142271422774 273 
3, Beis z 
1+ $e 1432-24 22 3 


A(z) 
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Solution MATLAB script: 


>> b = [1,2,2,1] a = [1, 13/24, 5/8, 1/3]; [K,C] = dir2ladrc(b) 


K= 
0.2500 0.5000 0.3333 
C= 
-0.2695 0.8281 1.4583 1.0000 
Hence 
1 1 1 
K K: K: 
1 4’ 2 2? 3 , 
and 


Co = —0.2695, Cı = 0.8281, C2 = 1.4583, C3 = 1 


x(n) 


x(n) y(n) 


(a) 


FIGURE 6.23 JIR filter structures in Example 6.10: (a) direct form (b) lattice- 
ladder form 


The resulting direct form and the lattice-ladder form structures are shown in 
Figure 6.23. To check that our lattice-ladder structure is correct, let us compute 
the first 8 samples of its impulse response using both forms. 


>> [x,n]=impseq(0,0,7) format long hdirect = filter(b,a,x) 
hdirect = 
Columns 1 through 4 
1.00000000000000 1.45833333333333 0.58506944444444 -0.56170428240741 
Columns 5 through 8 
-0.54752302758488 0.45261700163162 0.28426911049255 -0.25435705167494 
>> hladder = ladrfilt(K,C,x) 
hladder = 
Columns 1 through 4 
1.00000000000000 1.45833333333333 0.58506944444444 -0.56170428240741 
Columns 5 through 8 
-0.54752302758488 0.45261700163162 0.28426911049255 -0.25435705167494 
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Finally, we note that the SP toolbox also provides functions similar to 
the ones discussed in this section—the complementary functions, tf2latc 
and latc2tf, compute all-pole lattice, all-zero lattice, and lattice-ladder 
structure coefficients, and vice versa. Similarly, the function latcfilt 
(the same name as the book function) implements the all-zero lattice 
structure. The SP toolbox does not provide a function to implement the 
lattice-ladder structure. 


6.5 OVERVIEW OF FINITE-PRECISION NUMERICAL EFFECTS 
———————————— 


Until now we have considered digital filter designs and implementations 
in which both the filter coefficients and the filter operations such as addi- 
tions and multiplications were expressed using infinite-precision numbers. 
When discrete-time systems are implemented in hardware or in software, 
all parameters and arithmetic operations are implemented using finite- 
precision numbers and hence their effect is unavoidable. 

Consider a typical digital filter implemented as a direct-form IT struc- 
ture, which is shown in Figure 6.24a. When finite-precision representation 
is used in its implementation, there are three possible considerations that 
affect the overall quality of its output. We have to 


1. quantize filter coefficients, {a,, bk}, to obtain their finite word-length 
representations, {G,, bi}, 

2. quantize the input sequence, x(n) to obtain ĉ(n), and 

3. consider all internal arithmetic that must be converted to their next 
best representations. 


Thus, the output, y(n), is also a quantized value 9(n). This gives us a new 
filter realization, H(z), which is shown in Figure 6.24b. We hope that this 


(a) (b) 


FIGURE 6.24 Direct-form II digital filter implementation: (a) Infinite precision, 
(b) Finite precision 
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new filter H(z) and its output ĝ(n) are as close as possible to the original 
filter H(z) and the original output y(n). 

Since the quantization operation is a nonlinear operation, the overall 
analysis that takes into account all three effects described above is very 
difficult and tedious. Therefore, we will study each of these effects sepa- 
rately as though it were the only one acting at the time. This makes the 
analysis easier and the results more interpretable. 

We begin by discussing the number representation in a computer— 
more accurately, a central processing unit (CPU). This leads to the pro- 
cess of number quantization and the resulting error characterization. We 
then analyze the effects of filter coefficient quantization on digital filter 
frequency responses. The effects of multiplication and addition quantiza- 
tion (collectively known as arithmetic round-off errors) on filter output 
are discussed in Chapter 10. 


6.6 REPRESENTATION OF NUMBERS 
—— g 


In computers, numbers (real-valued or complex-valued, integers or frac- 
tions) are represented using binary digits (bits), which take the value of 
either a 0 or a 1. The finite word-length arithmetic needed for processing 
these numbers is implemented using two different approaches, depending 
on the ease of implementation and the accuracy as well as dynamic range 
needed in processing. The fixed-point arithmetic is easy to implement but 
has only a fixed dynamic range and accuracy (i.e., very large numbers or 
very small numbers). The floating-point arithmetic, on the other hand, has 
a wide dynamic range and a variable accuracy (relative to the magnitude 
of a number) but is more complicated to implement and analyze. 

Since a computer can operate only on a binary variable (e.g., a 1 or 
a 0), positive numbers can straightforwardly be represented using binary 
numbers. The problem arises as to how to represent the negative num- 
bers. There are three different formats used in each of these arithmetics: 
sign-magnitude format, one’s-complement format, and two’s-complement 
format. In discussing and analyzing these representations, we will mostly 
consider a binary number system containing bits. However, this discussion 
and analysis is also valid for any radix numbering system—for example, 
the hexadecimal, octal, or decimal system. 

In the following discussion, we will first begin with fixed-point signed 
integer arithmetic. A B-bit binary representation of an integer x is given 
by! 


x =bp_;bp_2... bo = bg—1 X on +bp_2xX JEMA en --+ bo X 20 (6.28) 


lHere the letter b is used to represent a binary bit. It is also used for filter coefficients 
{bk}. Its use in the text should be clear from the context. 
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where each bit b; represents either a 0 or a 1. This representation will 
help us to understand the advantages and disadvantages of each signed 
format and to develop simple MATLAB functions. We will then extend 
these concepts to fractional real numbers for both fixed-point and floating- 
point arithmetic. 


6.6.1 FIXED-POINT SIGNED INTEGER ARITHMETIC 

In this arithmetic, positive numbers are coded using their binary repre- 
sentation. For example, using 3 bits, we can represent numbers from 0 to 
7 as 


0 1 2 3 4 5 6 7 
-+----+----+----+----+----+----+----+- 


000 001 010 011 100 101 110 111 


Thus, with 8 bits the numbers represented can be 0 to 255, with 10 bits 
we can represent the numbers from 0 to 1023, and with 16 bits the range 
covered is 0 to 65535. For negative numbers, the following three formats 
are used: sign-magnitude, one’s-complement, and two’s-complement. 


Sign-magnitude format In this format, positive numbers are repre- 
sented using bits as before. However, the leftmost bit (also known as the 
most-significant bit or MSB) is used as the sign bit (0 is +, and 1 is —), 
and the remaining bits hold the absolute magnitude of the number as 
shown here: 


Sign Bit 
-+ Absolute Magnitude 
+---+---------------------- + 
|| | 
4t---4---------------------- + 


This system has thus two different codes for 0, one for the positive 0, the 
other one for the negative 0. For example, using 3 bits, we can represent 
numbers from —3 to 3 as 


-3 -2 -1 -0 0 1 2 3 
-+----+----+----+----+----+----+----+- 
111 110 101 100 000 001 010 011 


Thus, 8 bits cover the interval [—127, +127], while 16 bits cover [—32, 767, 
+32, 767]. If we use B bits in the sign-magnitude format, then we can 
represent integers from — (2871 — 1) to +(28-1 — 1) only. 

This format has two drawbacks. First, there are two representations 
for 0. Second, the arithmetic using sign-magnitude format requires one 
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rule to compute addition, another rule to compute subtraction, and a 
way to compare two magnitudes to determine their relative value before 
subtraction. 


MATLAB Implementation MATLAB is a 64-bit floating-point com- 
putation engine that provides results in decimal numbers. Therefore, 
fixed-point binary operations must be simulated in MATLAB. It provides 
a function, dec2bin, to convert a positive decimal integer into a B-bit 
representation, which is a symbol (or a code) and not a number. Hence 
it cannot be used in computation. Similarly, the function bin2dec con- 
verts a B-bit binary character code into a decimal integer. For example, 
dec2bin(3,3) gives 011 and bin2dec(’111’) results in 7. To obtain a 
sign-magnitude format, a sign bit must be prefixed. Similarly, to convert a 
sign-magnitude format, the leading bit must be used to impart a positive 
or negative value. These functions are explored in Problem P9.1. 


One’s-complement format In this format, the negation (or comple- 
mentation) of an integer x is obtained by complementing every bit (i.e., a 
0 is replaced by 1 and a 1 by 0) in the binary representation of x. Suppose 
the B-bit binary representation of x is bg_; bp_2 --- bo; then the B-bit 
one’s-complement, z, of x is given by 


he 
T = bp_1 bp_2--: bo 
where each bit b; is a complement of bit b;. Clearly then 
g+#=11...1=2?-1 (6.29) 


The MSB of the representation once again represents the sign bit, 
because the positive integer has the MSB of 0 so that its negation (or a 
negative integer) has the MSB of 1. The remaining bits represent either 
the number « (if positive) or its one’s-complement (if negative). Thus, 
using (6.29) the one’s-complement format representation? is given by 


5 T, <0 28 — 1- |e, <0 27-—1+2,2<0 ` 


Clearly, if B bits are available, then we can represent only integers from 
(—2P-14+1) to (+22-!—1), which is similar to the sign-magnitude format. 


?The one’s-complement format refers to the representation of positive and negative 
numbers, whereas the one’s-complement of a number refers to the negation of that 
number. 
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For example, using 3 bits, we can represent numbers from —3 to 3 as 


-3 -2 -1 -0 0 1 2 3 
-+----+----+----+----+----+----+----+- 
100 101 110 111 O00 001 010 O11 


which is a different bit arrangement for negative numbers compared to 
the sign-magnitude format. 

The advantage of this format is that subtraction can be achieved by 
adding the complement, which is very easy to obtain by simply comple- 
menting a number’s bits. However, there are many drawbacks. There are 
still two different codes for 0. The addition is a bit tricky to implement, 
and overflow management requires addition of the overflow bit to the least 
significant bit (or 2°). 


MATLAB Implementation The 1s-complement of a positive in- 
teger x using B bits can be obtained by using the built-in function 
bitcmp(x,B), which complements the number’s bits. The result is a dec- 
imal number between 0 and 2? — 1. As before, the dec2bin can be used 
to obtain the binary code. Using (6.30), we can develop the MATLAB 
function, OnesComplement, which obtains the one’s-complement format 
representation. It uses the sign of a number to determine when to use 
one’s-complement and can use scalar as well as vector values. The result 
is a decimal equivalent of the representation. 


function y = OnesComplement (x,B) 

% y = OnesComplement (x,B) 

figs Seas See SSE 

% Decimal equivalent of 

% Sign-Magnitude format integer to b-bit Ones’-Complement format conversion 


h 
% x: integer between -2^(b-1) < x < 2°(b-1) (sign-magnitude) 
% y: integer between 0 <= y <= 2^°b-1 (1’s-complement) 


if any((x <= -2°(B-1) | (x >= 2^(B-1)))) 

error(’Numbers must satisfy -2^(B-1) < x < 27(B-1)’) 
end 
s = sign(x); % sign of x (-1 if x<0, O if x=0, 1 if x>0) 
sb = (s < 0); 4% sign-bit (0 if x>=0, 1 if x<0)); 
y = (1-sb).*x + sb.*bitcmp(abs(x) ,B) ; 


EXAMPLE 6.11 Using the function OnesComplement, obtain one’s-complement format represen- 
tation of integers from —7 to 7 using 4 bits. 
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Solution MATLAB script: 


>> y = OnesComplement (x, 4) 


y = 
8 9 10 11 12 13 14 0 1 2 3 4 5 6 7 


Note that the number 15 is missing since we do not have —O in our original 


array. 


Two’s-complement format The disadvantage of having two codes for 
the number 0 is eliminated in this format. Positive numbers are coded as 
usual. The B-bit two’s-complement, x, of a positive integer x is given by 


č=7+1=2 -grz or e+#=2? (6.31) 


where the second equality is obtained from (6.30). Once again, the 
MSB of the representation provides the sign bit. Thus, using (6.31) the 
two’s-complement format representation? is given by 


_ fz, «>0_ fa, xr>0_ fa, xr>0 (6.32) 
TO) = Viale <0 23 —|z|,c<0 |28 +2,2<0 i 


Thus, in B-bit two’s-complement format negative numbers are obtained 
by adding 2? to them. Clearly, if B bits are available, then we can repre- 
sent 2” integers from (—2?—') to (+2371 — 1). For example, using 3 bits, 
we can represent numbers from —4 to 3 as 


-4 +3 =2 =4 0 1 2 3 
-+----+----+----+----+----+----+----+- 
100 101 110 111 000 001 010 O11 


This format, by shifting to the right (e.g., by incrementing) the code 
of the negative numbers, straightforwardly removes the problem of having 
2 codes for 0 and gives access to an additional negative number at the 
left of the line. Thus, 4 bits go from —8 to +7, 8 bits cover the interval 
[—127, +127] and 16 bits cover [—32768, +32767]. 


3 Again, the two’s-complement format refers to the representation of positive and neg- 
ative numbers, whereas the two’s-complement of a number refers to the negation of 
that number. 
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MATLAB Implementation Using (6.32), we can develop the 
MATLAB function, TwosComplement, which obtains the two’s-complement 
format representation. We can use the bitcmp function and then add one 
to the result to obtain the two’s-complement. However, we will use the 
last equality in (6.32) to obtain the two’s-complement since this approach 
will also be useful for fractional numbers. The function can use scalar 
as well as vector values. The result is a decimal equivalent of the two’s- 
complement representation. As before, the dec2bin can be used to obtain 
the binary code. 


function y = TwosComplement (x,b) 

% y = TwosComplement (x,b) 

Segara tem Nears Bee 

% Decimal equivalent of 

% Sign-Magnitude format integer to b-bit Ones’-Complement format conversion 


h 
h x: integer between -27(b-1) <= x < 27°(b-1) (sign-magnitude) 
16 y: integer between O <= y <= 2°b-1 (2’s-complement) 


if any((x < -27(b-1) | (x >= 2^(b-1)))) 
error(’Numbers must satisfy -2^(b-1) <= x < 27(b-1)’) 
end 
s = sign(x); % sign of x (-1 if x<0, 0 if x=0, 1 if x>0) 
sb = (s < 0); 4% sign-bit (O if x>=0, 1 if x<0)); 
y = (1-sb).*x + sb.*(2*btx); % or y = (1-sb).*x + sb.*(bitcmp(abs(x) ,b)+1) ; 


EXAMPLE 6.12 Using the function TwosComplement, obtain the two’s-complement format rep- 
resentation of integers from —8 to 7 using 4 bits. 


Solution MATLAB script: 


>> x = -8:7 
x= 

=e} =f -6 15} -4 -3 T2 El 0 1 2 3 4 5 6 Uf 
>> y = TwosComplement (x, 4) 
y= 

8 9 10 11 12 13 14 15 0 1 2 3 4 5 6 a 
>> y = dec2bin(y,4); disp(sprintf(’%s’, ly’ ;char(ones(1,16)*32)])) 
1000 1001 1010 1011 1100 1101 1110 1111 0000 0001 0010 0011 0100 0101 0110 0111 


The two’s-complement format has many interesting characteristics 
and advantages. These will be given after we discuss the next format, 
namely the ten’s-complement. 
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Ten’s-complement format This is a representation for decimal inte- 
gers. We will describe it so that we can explore characteristics of two’s- 
complement through decimal integers, which is much easier to understand. 
Following (6.31), the N-digit ten’s-complement of a positive integer x is 


given by 
&=10% -z or x+%=10% (6.33) 
Using (6.33), the N-digit ten’s-complement format representation is given 
by 
A Afz, 220. fa, x>0_ fa, x20 (6.34) 
(10%) ~ Yä, 2<0 110% — |e], x <07 10% +2,2<0 


Thus, in N-digit ten’s-complement format (which is sometimes re- 
ferred to as 10%-complement format), negative numbers are obtained by 
adding 10% to them. Clearly, when N digits are available, we can repre- 


sent 10% integers from ( 10%) to (4 ue 1). For example, using 1 digit, 
we can represent numbers from —5 to 4 as 


EXAMPLE 6.13 Using the 2-digit ten’s-complement, i.e., 100s-complement format, perform the 
following operations: 
1. 16 — 32, 2.32—16, 3. —30-— 40, 4.40+20-—30, 5. —40—20+4 30. 


Solution 1. 16 — 32 
First we note that 16 — 32 = —16. If we use the usual subtraction rule 
to proceed from right to left generating carries in the process, we cannot 
complete the operation. To use the 100s-complement format, we first note 
that in the 100s-complement format we have 


16,100) = 16, 16,100) = 100 16= 84, and 32 (100) = 100 32 68 


Hence 16 — 32 = 16+ 68 = 84 = —16 in the sign-magnitude format as 
expected. 

2. 32— 16 
In this case the 100s-complement format gives 


32 + 84 = 116 = 16 


in the sign-magnitude format by ignoring the generated carry digit. This is 
because the sign bits were different; therefore, the operation cannot generate 
an overflow. Hence, we check for overflow only if the sign bits are same. 

3. —30 — 40 
In this case the 100s-complement format gives 


(100 — 30) + (100 — 40) = 70 + 60 = 130 
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Since the sign bits were the same, an overflow is generated and the result is 
invalid. 

4. 40 + 20 — 30 
This is an example of more than one addition or subtraction. Since the final 
result is well within the range, the overflow can be ignored—that is, 


40 + 20 + (100 — 30) = 40 + 20 + 70 = 130 = 30 


which is a correct result. 


5. —40 — 20+ 30 
In this case, we have 


(100 — 40) + (100 — 20) + 30 = 60 + 80 + 30 = 170 = —30 


in the sign-magnitude format, which is, again, a correct result. 


MATLAB Implementation Using (6.34), one can develop the 
MATLAB function, TensComplement, which obtains ten’s-complement 
format representation. It is similar to the TwosComplement function and 
is explored in Problem P6.25. 


Advantages of two’s-complement format Using the results of the 
Example 6.13, we now state the benefits of the two’s-complement format. 
These also hold (with obvious modifications) for the ten’s-complement 
format. 


1. It provides for all 2?+1 distinct representations for a B-bit fractional 
representation. There is only one representation for zero. 

2. This complement is compatible with our notion of negation: the com- 
plement of a complement is the number itself. 

3. It unifies the subtraction and addition operations (subtractions are 
essentially additions). 

4. Inasum of more than two numbers, the internal overflows do not affect 
the final result so long as the result is within the range (i.e., adding 
two positive numbers gives a positive result, and adding two negative 
numbers gives a negative result). 


Hence in most A/D converters and processors, negative numbers are rep- 
resented using two’s-complement format. Almost all current processors 
implement signed arithmetic using this format and provide special func- 
tions (e.g., an overflow flag) to support it. 


Excess-2?-1 format This format is used in describing the exponent 
of floating-point arithmetic; hence it is briefly discussed here. In excess- 
28-1 signed format (also known as a biased format), all positive and 
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9B-1 9B-1 


negative integers between — and — 1 are given by 


Xe) = 287l 4r (6.35) 


For example, using 3 bits, we can represent the numbers from —4 to 
3 as 
-4 =3 -2 -1 0 1 2 3 
-+----+----+----+----+----+----+----+- 
000 001 010 O11 100 101 110 111 


Notice that this format is very similar to the two’s-complement format, 
but the sign bit is complemented. The arithmetic for this format is similar 
to that of the two’s-complement format. It is used in the exponent of 
floating-point number representation. 


6.6.2 GENERAL FIXED-POINT ARITHMETIC 
Using the discussion of integer arithmetic from the last section as a guide, 
we can extend the fixed-point representation to arbitrary real (integer 
and fractional) numbers. We assume that a given infinite-precision real 
number, x, is approximated by a binary number, ĉ, with the following bit 
arrangement: 

ĉ= + XXX a XXX (6.36) 

A S 


N: 


«rI ba 7? 
Sign bit L B 
Integer bits Fraction bits 


where the sign bit + is 0 for positive numbers and 1 for negative numbers, 
x represents either a 0 or a 1, and a represents the binary point. This 
representation is in fact the sign-magnitude format for real numbers, as 
we will see. The total word length of the number ĉ is then equal to 2+ B+1 
bits. 


EXAMPLE 6.14 Let L = 4and B = 5, which means ĉ is a 10-bit number. Represent 11010401110 


in decimal. 
Solution 
ê = (1 2 +0 x2? E10 x 20 +0x271+1x2? +1 x27 +1 x27 +0 x27) 
= —10.4375 
in decimal. 


In many A/D converters and processors, the real numbers are scaled 
so that the fixed-point representation is in the (—1,1) range. This has 
the advantage that the multiplication of two fractions is always a fraction 
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and, as such, there is no overflow. Hence we will consider the following 
representation: 


& = A( a xxxxxx---x) (6.37) 
S 


B fraction bits 


where A is a positive scaling factor. 


EXAMPLE 6.15 Represent the number ĉ = —10.4375 in Example 6.14 using a fraction-only 
arrangement. 
Solution Choose A = 24 = 16 and B = 9. Then 


& = —10.4375 = 16 (14101001110) 


Hence by properly choosing A and B, one can obtain any fraction-only repre- 
sentation. 

Note: The scalar A need not be a power of 2. In fact, by choosing any real number 
A we can obtain an arbitrary range. The power-of-2 choice for A, however, makes 
hardware implementation a little easier. 


As discussed in the previous section, there are three main formats for 
fixed-point arithmetic, depending on how negative numbers are obtained. 
For all these formats, positive numbers have exactly the same represen- 
tation. In the following we assume the fraction-only arrangement. 


Sign-magnitude format As the name suggests, the magnitude is 
given by the B-bit fraction, and the sign is given by the MSB. Thus, 
n | Oax1X2Q---xp ifa > 0 
en non ifx <0 (0:28) 


For example, when B = 2, ĉ = +1/4 is represented by & = 0401, and 
& = —1/4 is represented by ĉ = 1401. 


One’s-complement format In this format, the positive numbers have 
the same representation as the sign-magnitude format. When the number 
is negative, then its magnitude is given by its bit-complement arrange- 
ment. Thus, 


(6.39) 


a 04 X1X2 °: XB ifx>0 
C= oe ADA 
1aXıž2 -Xp ifx <0 


For example, when B = 2, ĉ = +1/4 is represented by & = 0401, and 
& = —1/4 is represented by ĉ = 1410. 
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Two’s-complement format Once again, the positive numbers have 
the same representation. Negative numbers are obtained by first comple- 
menting the magnitude and then modulo-2 adding one to the last bit 
or the least-significant bit (LSB). Stated differently, two’s-complement is 
formed by subtracting the magnitude of the number from 2. Thus 


~ J Oax,Xo°++XB ifa > 0 
T= ) 2 = |a| = 143132- žpg ® 0100---1 = layyyy--- yp if z <0 
(6.40) 


where © represents modulo-2 addition and bit y is, in general, different 
from bit x. For example, when B = 2, ĉ = +1/4 is represented by ĉ = 
0401, and ĉ = —1/4 is represented by ĉ = 14106 0401 = 1411. 


EXAMPLE 6.16 Let B = 3; then ĉ is a 4-bit number (sign plus 3 bits). Provide all possible 
values that ĉ can take in each of the three formats. 


Solution There are 2* = 16 possible values that @ can take for each of the three formats, 
as shown in the following table. 


Binary Sign-Magnitude one’s two’s 
04111 7/8 7/8 7/8 
04110 6/8 6/8 6/8 
04101 5/8 5/8 5/8 
04 100 4/8 4/8 4/8 
04011 3/8 3/8 3/8 
04010 2/8 2/8 2/8 
04001 1/8 1/8 1/8 
04 000 0 0 0 
14000 —0 —7/8 —1 
14001 —1/8 —6/8 —7/8 
14010 —2/8 —5/8 —6/8 
14011 —3/8 —4/8 —5/8 
14100 —4/8 —3/8 —4/8 
14101 —5/8 —2/8 —3/8 
14110 —6/8 —1/8 —2/8 
14111 —7/8 —0 —1/8 


In the Example, observe that the bit arrangement is exactly the same 
as in the integer case for 4 bits. The only difference is in the position of 
the binary point. Thus the MATLAB programs developed in the previ- 
ous section can easily be used with proper modifications. The MATLAB 
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function sm2oc converts a decimal sign-magnitude fraction into its one’s- 
complement format, while the function oc2sm performs the inverse opera- 
tion. These functions are explored in Problem P6.24. Similarly, MATLAB 
functions sm2tc and tc2sm convert a decimal sign-magnitude fraction 
into its two’s-complement format and vice versa, respectively; they are 
explored in Problem P6.25. 


6.6.3 FLOATING-POINT ARITHMETIC 

In many applications, the range of numbers needed is very large. For 
example, in physics one might need, at the same time, the mass of the sun 
(e.g., 2.10°°ke) and the mass of the electron (e.g., 9.107 *'kg). These two 
numbers cover a range of over 10°°. For fixed-point arithmetic, we would 
need 62-digit numbers (or 62-digit precision). However, even the mass of 
the sun is not accurately known with a precision of 5 digits, and there is 
almost no measurement in physics that could be made with a precision of 
62 digits. One could then imagine making all calculations with a precision 
of 62 digits and throwing away 50 or 60 of them before printing out the 
final results. This would be wasteful of both CPU time and memory space. 
So what is needed is a system for representing numbers in which the range 
of expressible numbers is independent of the number of significant digits. 


Decimal numbers The floating-point representation for a decimal 
number x is based on expressing the number in the scientific notation: 


r= +M x 10+” 


where M is called the mantissa and E is the exponent. However, there 
are different possible representations of the same number, depending on 
the actual position of the decimal point—for example, 


1234 = 0.1234 x 10* = 1.234 x 10° = 12.34 x 10? =--- 


To fix this problem, a floating-point number is always stored using 
a unique representation, which has only one nonzero digit to the left 
of the decimal point. This representation of a floating-point number is 
called a normalized form. The normalized form of the preceding number 
is 1.234 x 10°, because it is the only representation resulting in a unique 
nonzero digit to the left of the decimal point. The digit arrangement for 
the normalized form is given by 


sign of M sign of E 


T= oe Xa XXX Eo XXX (6.41) 
—— —~-— 
N-bit M L-bit E 
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For the negative numbers we have the same formats as the fixed-point 
representations, including the 10s-complement format. 

The number of digits used in the exponent determine the range of 
representable numbers, whereas the number of digits used in the mantissa 
determine the precision of the numbers. For example, if the mantissa is 
expressed using 2 digits plus the sign, and the exponent is expressed using 
2 digits plus the sign, then the real number line will be covered as: 


-9.99x10°"” -1.0x10 me (0) 1.0x10 39 9.99x10°"” 
---------= $os-2---------4-----------F----------- 4-5 --------- = fat aar------> 
| accessible | (0 | accessible | 
negative | negative | negative | positive | positive | positive 
overflow | numbers | underflow | underflow | numbers | overflow 


The range of accessible floating-point numbers with a given representation 
can be large, but it is still finite. In the preceding example (e.g., with 2 dig- 
its for the mantissa and 2 digits for the exponent), there are only 9 x 10 x 
10x199 = 179, 100 positive numbers, and as many negative numbers, plus 
the number zero, for a total of 358,201 numbers that can be represented. 


Binary numbers Although the fraction-only fixed-point arithmetic 
does not have any overflow problems when two numbers are multiplied, it 
does suffer from overflow problems when two numbers are added. Also, the 
fixed-point numbers have limited dynamic range. Both of these aspects 
are unacceptable for an intensive computational job. These limitations 
can be removed by making the binary point a floating rather than fixed. 

The floating-point bit arrangement for binary-number representation 
is similar to that for the decimal numbers. In practice, however, two ex- 
ceptions are made. The exponent is expressed using L-bit excess-2'—! 
format, and the B-bit normalized mantissa is a fractional number with 
a 1 following the binary point. Note that the sign bit is the MSB of the 
bit pattern. Thus the B-bit mantissa and L-bit exponent (for a total of 
B+L+41 word length) bit pattern is given by (note the reversal of the 
mantissa exponent places) 


Sign of M 
= + xxx a IX-X (6.42) 
SVS QoV— 
L-bit E — B-bit M 


where exponent E is adjusted so that we have a normalized mantissa— 
that is, 1/2 < M < 1. Hence the first bit after the binary point is always 1. 
The decimal equivalent of ĉ is given by 


ĉ = +M x gf (6.43) 


For the negative numbers we can have the same formats as the fixed-point 
representations for the mantissa including two’s-complement format. 
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However, the most widely used format for the mantissa is the sign- 
magnitude one. 


EXAMPLE 6.17 Consider a 32-bit floating-point word with the following arrangement: 


&=Axx---x a Ix---x 
D —S—S—”" 


8-bit £ 23-bit M 


Determine the decimal equivalent of 


01000001111000000000000000000000 


Solution Since the exponent is 8-bit, it is expressed in excess-2” or in excess-128 format. 
Then the bit pattern can be partitioned into 


Sign 


& = 0 10000011 a 11000000000000000000000 
SSS a 


B=131 M=2-142-2 


The sign bit is 0, which means that the number is positive. The exponent code is 
131, which means that its decimal value is 131 — 128 = 3. Thus, the bit pattern 
represents the decimal number ¢ = + (25 + 27?) (28) = 2? +21 =6. 


EXAMPLE 6.18 Let ĉ = —0.1875. Represent ĉ using the format given in (6.42), in which B = 11, 
L = 4 (for a total of 16 bits), and sign-magnitude format is used for the mantissa. 


Solution We can write 
ĉ = —0.1875 = —0.75 x 27? 
Hence the exponent is —2, the mantissa is 0.75, and the sign is negative. The 
4-bit exponent, in excess-8 format, is expressed as 8 — 2 = 6 or with bit pattern 
0110. The mantissa is expressed as 11000000000. Since ĉ is negative, the bit 


pattern is 


ĉ = 1011011000000000 


The advantages of the floating-point representation are that it has 
a large dynamic range and that its resolution, defined as the interval 
between two consecutive representable levels, is proportional to the mag- 
nitude. The disadvantages include no representation for the number 0 and 
the fact that the arithmetic operations are more complicated than their 
fixed-point representations. 
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IEEE 754 standard In the early days of the digital computer revolu- 
tion, each processor design had its own internal representation for floating- 
point numbers. Since floating-point arithmetic is more complicated to 
implement, some of these designs did incorrect arithmetic. Therefore, in 
1985 IEEE issued a standard (IEEE standard 754-1985 or IEEE-754 for 
short) to allow floating-point data exchange among different computers 
and to provide hardware designers with a model known to be correct. Cur- 
rently, almost all manufacturers design main processors or a dedicated 
coprocessor for floating-point operations using the IEEE-754 standard 
representation. 

The IEEE 754 standard defines three formats for binary numbers: a 
32-bit single precision format, a 64-bit double precision format, and an 
80-bit temporary format (which is used internally by the processors or 
arithmetic coprocessors to minimize rounding errors). 

We will briefly describe the 32-bit single precision standard. This 
standard has many similarities with the floating-point representation dis- 
cussed above, but there are also differences. Remember, this is another 
model advocated by IEEE. The form of this model is 


sign of M 


B= 4 XxX a XxX (6.44) 
= = 
8—bit E 23—bit M 


The mantissa’s value is called the significand in this standard. Features 
of this model are as follows: 


e If the sign bit is 0, the number is positive; if the sign bit is 1, the 
number is negative. 

e The exponent is coded in 8-bit excess-127 (and not 128) format. Hence 
the uncoded exponents are between —127 and 128. 

e The mantissa is in 23-bit binary. A normalized mantissa always starts 
with a bit 1, followed by the binary point, followed by the rest of the 
23-bit mantissa. However, the leading bit 1, which is always present in a 
normalized mantissa, is hidden (not stored) and needs to be restored for 
computation. Again, note that this is different from the usual definition 
of the normalized mantissa. If all the 23 bits representing the mantissa 
are set to 0, the significand is 1 (remember the implicit leading 1). If 
all 23 bits are set to 1, the significand is almost 2 (in fact 2— 277%). All 
IEEE 754 normalized numbers have a significand that is in the interval 
1<M <2. 

e The smallest normalized number is , and the greatest normalized 
number is almost 2!?8, The resulting positive decimal range is roughly 
10788 to 1038 with a similar negative range. 

e If E = 0 and M = 0, then the representation is interpreted as a de- 
normalized number (i.e., the hidden bit is 0) and is assigned a value of 


9-126 
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+0, depending on the sign bit (called the soft zero). Thus 0 has two 
representations. 

e If E = 255 and M F 0, then the representation is interpreted as a 
not-a-number (abbreviated as NaN). MATLAB assigns a variable NaN 
when this happens—e.g., 0/0. 

e If E = 255 and M = 0, then the representation is interpreted as +00. 
MATLAB assigns a variable inf when this happens—e.g., 1/0. 


EXAMPLE 6.19 Consider the bit pattern given in Example 6.17. Assuming IEEE-754 format, 
determine its decimal equivalent. 


Solution The sign bit is 0 and the exponent code is 131, which means that the exponent 
is 131 — 127 = 4. The significand is 1 +271 +27? = 1.75. Hence the bit pattern 
represents 


&=4+(14+2714277)(24) = 24 4+ 23 + 2? = 28 


which is different from the number in Example 6.17. 


MATLAB employs the 64-bit double-precision IEEE-754 format for 
all its number representations and the 80-bit temporary format for its in- 
ternal computations. Hence all calculations that we perform in MATLAB 
are in fact floating-point computations. Simulating a different floating- 
point format in MATLAB would be much more complicated and would 
not add any more insight to our understanding than the native format. 
Hence we will not consider a MATLAB simulation of floating-point arith- 
metic as we did for fixed-point. 


6.7 THE PROCESS OF QUANTIZATION AND ERROR 


CHARACTERIZATIONS 
—— ee 


From the discussion of number representations in the previous section, it 
should be clear that a general infinite-precision real number must be as- 
signed to one of the finite representable number, given a specific structure 
for the finite-length register (that is, the arithmetic as well as the format). 
Usually in practice, there are two different operations by which this as- 
signment is made to the nearest number or level: the truncation operation 
and the rounding operation. These operations affect the accuracy as well 
as general characteristics of digital filters and DSP operations. 

We assume, without loss of generality, that there are B + 1 bits in 
the fixed-point (fractional) arithmetic or in the mantissa of floating-point 
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arithmetic including the sign bit. Then the resolution (A) is given by 


A=2-8 { absolute in the case of fixed-point arithmetic (6.45) 


relative in the case of floating-point arithmetic 


6.7.1 FIXED-POINT ARITHMETIC 
The quantizer block diagram in this case is given by 


x — | Quantizer Q[-]|— Ola] 
Infinite— precision B, A Finite—precision 


where B, the number of fractional bits, and A, the resolution, are the pa- 
rameters of the quantizer. We will denote the finite word-length number, 
after quantization, by Q[a] for an input number x. Let the quantization 
error be given by 


eĉ Qjz] -z (6.46) 


We will analyze this error for both the truncation and the rounding 
operations. 


Truncation operation In this operation, the number z is truncated 
beyond B significant bits (that is, the rest of the bits are eliminated) to 
obtain Qr|z]. In MATLAB, to obtain a B-bit truncation, we have to first 
scale the number x upward by 2#, then use the fix function on the scaled 
number, and finally scale the result down by 2~?. Thus, the MATLAB 
statement xhat = fix(x*2°7B)/2°B; implements the desired operation. 
We will now consider each of the 3 formats. 


Sign-magnitude format If the number z is positive, then after trun- 
cation Qr|zx] < x since some value in x is lost. Hence quantizer error for 
truncation denoted by er is less than or equal to 0 or er < 0. However, 
since there are B bits in the quantizer, the maximum error in terms of 
magnitude is 


ler] = 0a 00---Q 111--- = 27% (decimal) (6.47) 
Bbits 
or 
-27B <ep<0, forxz>0 (6.48) 


Similarly, if the x < 0 then after truncation Q7[2] > x since Qr[z] is less 
negative, or er > 0. The largest magnitude of this error is again 2~? or 


O<er<2°-8, forrx <0 (6.49) 
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FIGURE 6.25 Truncation error characteristics in the sign-magnitude format 


EXAMPLE 6.20 Let —1 < x < 1 and B = 2. Using MATLAB, verify the truncation error 
characteristics. 


Solution The resolution is A = 27°? = 0.25. Using the following MATLAB script, we can 
verify the truncation error er relations given in (6.48) and (6.49). 


x = [-1+27(-10) :27(-10) :1-27(-10)]; % Sign-Mag numbers between -1 and 1 
B = 2; 4, Number of bits for Truncation 
xhat = fix(x*2°B)/27B ù% Truncation 


plot(x,x,’g’,x,xhat,’r’,’linewidth’,1); % Plot 


The resulting plots of x and ĉ are shown in Figure 6.25. Note that the plot of 
& has a staircase shape and that it satisfies (6.48) and (6.49). 


One’s-complement format For x > 0, we have the same character- 
istics for ep as in sign-magnitude format—that is, 
2-2 <erp<0, forx>0 (6.50) 


For x < 0, the representation is obtained by complementing all bits in- 
cluding sign bit. To compute maximum error, let 


z = labybo--+bp000--- = — {a (1 — b1) (1 — b2) +- (1 — bp) 111---} 


After truncation, we obtain 


Qrlz] = 1ab,bg--- bp = {a (1 bı) (1 b2)--- (1 — bg)} 
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FIGURE 6.26 Truncation error characteristics in the one’s-complement format 


Clearly, x is more negative than Qr[|zx] or « < Qr[|zx] or er > 0. In fact, 
the maximum truncation error is 


€Tmax = 0400---O111---= 27B (decimal) 


Hence 


0<er <27, forx<0 (6.51) 


? 


EXAMPLE 6.21 Again let —1 < x < 1 and B = 2 with the resolution A = 27? = 0.25. Using 
MATLAB script, verify the truncation error er relations given in (6.50) and 
(6.51). 


Solution The MATLAB script uses functions sm2oc and oc2sm, which are explored in 
Problem P6.25. 


x = [-1+27(-10) :27(-10) :1-27(-10)]; % Sign-Magnitude numbers between -1 and 1 
B = 2; % Select bits for Truncation 

y = sm2oc(x,B); % Sign-Mag to One’s Complement 

yhat = fix(y*2°B)/2°B; % Truncation 

xhat = oc2sm(yhat,B) ; % Ones’-Complement to Sign-Mag 


plot(x,x,’g’,x,xhat,’r’,’linewidth’,1); % Plot 


The resulting plots of x and ĉ are shown in Figure 6.26. Note that the 
plot of ĉ is identical to the plot in Figure 6.25 and that it satisfies (6.50) 
and (6.51). 
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Two’s-complement format Once again, for x > 0, we have 
—27P <er <0, forr>0 (6.52) 


For x < 0, the representation is given by 2 — |x| where |x] is the magnitude. 
Hence the magnitude of x is given by 


jx] =2-—2 (6.53) 
with « = 1abjbo---bgbp41---. After truncation to B bits, we obtain 
Or|z] = 1a bıb2 -- -bp the magnitude of which is 

|Or[x]| = 2 — Qr[z] (6.54) 


From (6.53) and (6.54) 


|Or[2]| aay |z| = Tt — Qrlz] = 1a b1b2 a -bgbB+1 ASR mar lab, be at -bB 
= 00044 0bg41 ++ (6.55) 


The largest change in magnitude from (6.55) is 
0400---0111--- = 2~8 (decimal) (6.56) 


Since the change in the magnitude is positive, then after truncation Qrfz] 
becomes more negative, which means that Qr|a] < x. Hence 


2-2 <erp<0, forr<0 (6.57) 


EXAMPLE 6.22 Again consider —1 < x < 1 and B = 2 with the resolution A = 27? = 0.25. 
Using MATLAB, verify the truncation error er relations given in (6.52) and 
(6.57). 


Solution The MATLAB script uses functions sm2tc and tc2sm, which are explored in 
Problem P9.4. 


x = [-1+27(-10):27(-10):1-27(-10)]; % Sign-Magnitude numbers between -1 and 1 


B = 2; % Select bits for Truncation 
y = sm2tc(x); % Sign-Mag to Two’s Complement 
yhat = fix(y*2°B)/27B; % Truncation 

xq = tc2sm(yq ); % Two’s-Complement to Sign-Mag 


plot(x,x,’g’,x,xhat,’r’,’linewidth’,1); % Plot 


The resulting plots of x and ĉ are shown in Figure 6.27. Note that the plot of 
& is also a staircase graph but is below the x graph and that it satisfies (6.52) 
and (6.57). 


Collecting results (6.48)—(6.52), and (6.57) along with in Figures 6.25- 
6.27, we conclude that the truncation characteristics for fixed-point 
arithmetic are the same for the sign-magnitude and the one’s-complement 
formats but are different for the two’s-complement format. 
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FIGURE 6.27 Truncation error characteristics in the two’s-complement format 


Rounding operation In this operation, the real number x is rounded 
to the nearest representable level, which we will refer to as Qrf|z]. In 
MATLAB, to obtain a B-bit rounding approximation, we have to first 
scale the number x up by 2?, then use the round function on the scaled 
number, and finally scale the result down by 272. Thus the MAT- 
LAB statement xhat = round(x*27B)/27B; implements the desired 
operation. 

Since the quantization step or resolution is A = 278, the magnitude 
of the maximum error is 


A lsp 


e—a SS ZDR 
erate 2 


; (6.58) 


Hence for all three formats, the quantizer error due to rounding, denoted 


by er, satisfies 


1 1 


EXAMPLE 6.23 Demonstrate the rounding operations and the corresponding error characteris- 
tics on the signal of Examples 6.20-6.22 using the three formats. 


Solution Since the rounding operation assigns values that can be larger than the unquan- 
tized values, which can create problems for the two’s- and one’s-complement 
format, we will restrict the signal over the interval [—1, 1 — 2777+]. The follow- 
ing MATLAB script shows the two’s-complement format rounding, but other 
scripts are similar (readers are encouraged to verify). 
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(b) Sign-Magnitude Format (b) Ones-Complement Format (b) Two-Complement Format 
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FIGURE 6.28 Rounding error characteristics in the fixed-point representation 


= 2; % Select bits for Rounding 
56 = [Sl g2 (ail) gil" 3=31)) 1 8 % Sign-Magnitude numbers between -1 and 1 
y = sm2tc(x); % Sign-Mag to Two’s Complement 
yq = round(y*2°B)/27B; % Rounding 
xq = tc2sm(yq) ; % Two’-Complement to Sign-Mag 


The resulting plots for the sign-magnitude, ones-, and two’s-complement 
formats are shown in Figure 6.28. These plots do satisfy (6.59). 


Comparing the error characteristics of the truncation and rounding 
operations given in Figures 6.25 through 6.28, it is clear that the rounding 
operation is a superior one for the quantization error. This is because the 
error is symmetric with respect to zero (or equal positive and negative 
distribution) and because the error is the same across all three formats. 
Hence we will mostly consider the rounding operation for the floating- 
point arithmetic as well as for further analysis. 


6.7.2 FLOATING-POINT ARITHMETIC 

In this arithmetic, the quantizer affects only the mantissa M. However, 
the number zx is represented by M x 2” where E is the exponent. Hence 
the quantizer errors are multiplicative and depend on the magnitude of 
x. Therefore, the more appropriate measure of error is the relative error 
rather than the absolute error, (Q[] — x). Let us define the relative error, 


E€, as 
¿ê Qle] -7 (6.60) 
x 
Then the quantized value Q[] can be written as 
Ola] =x+ex=2(1+e) (6.61) 
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When Q[z] is due to the rounding operation, then the error in the man- 
tissa is between [-$2~?, 427P]. In this case we will denote the relative 
error by er. Then from (6.43), the absolute error, QOp[z] — x = erz, is 


between i i 
(-32°*) 2F < ena < (32°) oF (6.62) 


Now for a given F, and since the mantissa is between $ <M <1 (this is 
not the IEEE-754 model), the number x is between 


DPM L gam (6.63) 
Hence from (6.62) and using the smallest value in (6.63), we obtain 
E oe (6.64) 


This relative error relation, (6.64), will be used in subsequent analysis. 


6.8 QUANTIZATION OF FILTER COEFFICIENTS 
eee eee 


We now study the finite word-length effects on the filter responses, pole- 
zero locations, and stability when the filter coefficients are quantized. We 
will separately discuss the issues relating to IIR and FIR filters since we 
can obtain simpler results for FIR filters. We begin with the case of IIR, 
filters. 


6.8.1 IIR FILTERS 
Consider a general IIR filter described by 


M —k 
bkz 
H(z) = rob (6.65) 
1+ Jop nz -* 
where aps and bgs are the filter coefficients. Now assume that these coeffi- 
cients are represented by their finite precision numbers âs and bys. Then 
we get a new filter system function 


Fine pe baz 
1 + nen apz—* 


Since this is a new filter, we want to know how “different” this filter is 
from the original one H(z). Various aspects can be compared; for example, 
we may want to compare their magnitude responses, or phase responses, 
or change in their pole-zero locations, and so on. A general analytical 
expression to compute this change in all these aspects is difficult to derive. 
This is where MATLAB can be used to investigate this change and its 
overall effect on the usability of the filter. 


(6.66) 
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6.8.2 EFFECT ON POLE-ZERO LOCATIONS 
One aspect can be reasonably analyzed, which is the movement of filter 
poles when az is changed to ay. This can be used to check the stabil- 
ity of IIR filters. A similar movement of zeros to changes in numerator 
coefficients can also be analyzed. 

To evaluate this movement, consider the denominator polynomial of 
H(z) in (6.65) 


N 


= 2j + Sone" = II ( (1 — pe zoe) (6.67) 


£=1 


where {pọ}s are the poles of H(z). We will regard D(z) as a function 
D(pı,..., pyn) of poles {p1,...,pn} where each pole pẹ is a function of the 
filter coefficients {a1,...,an}—that is, pe = f(a1,...,aw), €=1,...N. 
Then the change in the denominator D(z) due to a change in the kth 
coefficient a, is given by 


(2-2) (AR) E 


(6.68) 


where from (6.67) 


N 
(Co) = op T-rex 2 |=- =- |[|(1-pez) (6.69) 


l=1 LHi 


From (6.69), note that (2 Pil) 


= 0 for £ # i. Hence from (6.68) we 


Z=Pe 
obtain 
(28) 
(BAJ (BEY) (Z) æ (Me) -e 
ðar /\,— Ope J |z-p, \ Gn Jar aD) 
pe pe ( Ope ) =p 
(6.70) 
Now 
OD(z) x e na 
( Oar Vr Oar a (14 Som ) E pe T (6.71) 


z=pg 


From (6.69), (6.70) and (6.71), we obtain 


(2) p pz" ___ Pe (6.72) 
Oar, mee egy (1 — pi 271) [ize (pe — pi ) 


Z=Pe 
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Im{z} 
Zz 
A Z> 23 
J Relg 4 
Z 2 i 
25 22 23 
Z3 
(a) Direct-form Arrangement (b) Cascade- or Parallel-form Arrangement 
FIGURE 6.29 z-plane plots of tightly clustered poles of a digital filter 
Finally, the total perturbation error App can be expressed as 
N dp 
Ape = X` “Aa 6.73 


This formula measures the movement of the ¢th pole, pe, to changes in 
each of the coefficient {ap}; hence it is known as a sensitivity formula. 
It shows that if the coefficients {ax } are such that if the poles pọ and p; are 
very close for some £, i, then (pe — p;i) is very small and as a result the filter 
is very sensitive to the changes in filter coefficients. A similar result can 
be obtained for the sensitivity of zeros to changes in the parameters {bx}. 

To investigate this further in the light of various filter realizations, 
consider the z-plane plot shown in Figure 6.29(a) where poles are tightly 
clustered. This situation arises in wideband frequency selective filters such 
as lowpass or highpass filters. Now if we were to realize this filter using the 
direct form (either I or IT), then the filter has all these tightly clustered 
poles, which makes the direct-form realization very sensitive to coefficient 
changes due to finite word length. Thus, the direct form realizations will 
suffer severely from coefficient quantization effects. 

On the other hand, if we were to use either the cascade or the parallel 
forms, then we would realize the filter using 2nd-order sections containing 
widely separated poles, as shown in Figure 6.29(b). Thus, each 2nd-order 
section will have low sensitivity in that its pole locations will be perturbed 
only slightly. Consequently, we expect that the overall system function 
H(z) will be perturbed only slightly. Thus, the cascade or the parallel 
forms, when realized properly, will have low sensitivity to the changes or 
errors in filter coefficients. 


EXAMPLE 6.24 Consider a digital resonator that is a 2nd-order IIR filter given by 
be 1 
1 — (2rcos@) 2-1 + r2z7-? 


H(z) (6.74) 


Analyze its sensitivity to pole locations when a 3-bit sign-magnitude format is 
used for the coefficient representation. 
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x{n} o 


Re{z} 


(a) (b) 
FIGURE 6.30 Digital filter in Example 6.24 (a) pole-zero plot, (b) filter realiza- 
tion 
Solution The filter has two complex-conjugate poles at 
pı = re? and p2 = re?) = pi 


For a proper operation as a resonator, the poles must be close to the unit 
circle—that is, r ~ 1 (but r < 1). Then the resonant frequency wr ~ 0. 
The zero-pole diagram is shown in Figure 6.30 along with the filter realiza- 
tion. Let r = 0.9 and 0 = 7/3. Then from (6.74), 


a, = —2r cos = —0.9 and az= r? = 0.81 


We now represent a; and az, each using 3-bit sign-magnitude format 
representation—that is, 


ak = + abı b2 b3 = + (b12 1 + b22 2 4 b32 °), k=1,2 


where b; represents the jth bit and a represents the binary point. Then for the 
closest representation, we must have 


âı = 14111 = —0.875 and â2 = 04110 = +0.75 


Hence |Aa,| = 0.025 and |Aaz| = 0.06. Consider the sensitivity formula (6.73) 


in which 
Opi pot -pm =e? it 8 ae 
dar (pi—pi) 2Im{pı} 2r(sin0) V3” 
Sr i? nn 
daz (pı = pi) 2Im{pit 0.9V3 


Using (6.73), we obtain 


x 


Op1 
Aril < [ae 


a 
[Aa] + | lAa] 


1 1 
5 (0.025) + 18 (0.06) = 0.0529 (6.75) 
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To determine the exact locations of the changed poles, consider the changed 
denominator 


D (z) = 1-0.875z7* + 0.7527? = (1 — 0.866e7"9'"z~") (1 — 0.866e 79°99!" 2-*) 


Thus, the changed pole locations are pı = 0.866e7°°?!" = 3. Then |Api| = 
|0.9e'*/ — 0.866e"°*!*| = 0.0344, which agrees with (6.75). 


Analysis using MATLAB To investigate the effect of coefficient 
quantization on filter behavior, MATLAB is an ideal vehicle. Using func- 
tions developed in previous sections, we can obtain quantized coefficients 
and then study such aspects as pole-zero movements, frequency response, 
or impulse response. We will have to represent all filter coefficients using 
the same number of integer and fraction bits. Hence instead of quan- 
tizing each coefficient separately, we will develop the function, QCoeff, 
for coefficient quantization. This function implements quantization using 
rounding operation on sign-magnitude format. Although similar functions 
can be written for truncation as well as for other formats, we will analyze 
the effects using the Qcoeff function as explained previously. 


function [y,L,B] = QCoeff(x,N) 
% [y,L,B] = QCoeff(x,N) 


h Coefficient Quantization using N=1+L+B bit Representation 
hh with Rounding operation 

h y: quantized array (same dim as x) 
% L: number of integer bits 

% B: number of fractional bits 

% x: a scalar, vector, or matrix 

% N: total number of bits 

xm = abs(x); 

L = max(max(0,fix(log2(xm(:)+eps)+1))); % Integer bits 

if (L > N) 

errmsg = [? *** N must be at least ’,num2str(L),’ ***’]; error (errmsg); 

end 

B = N-L; % Fractional bits 

y = xm./(2°L); y = round(y.*(2°N)); % Rounding to N bits 

y = sign(x).*y*(27(-B)); % L+B+1 bit representation 


The Qcoeff function represents each coefficient in the x array using 
N+1-bit (including the sign bit) representation. First, it determines the 
number of bits L needed for integer representation for the magnitude-wise 
largest coefficient, and then it assigns N-L bits to the fraction part. The 
resulting number is returned in B. Thus all coefficients have the same bit 
pattern L+B+1. Clearly, N > L. 
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EXAMPLE 6.25 Consider the digital resonator in Example 6.24. Determine the change in the 
pole locations using MATLAB. 


Solution The filter coefficients, aj = —0.9 and az = 0.81 can be quantized using 


>> x = [-0.9,0.81]; [y,L,B] = Qcoeff(x,3) 
y = -0.8750 0.7500 

L 
B= 


O 
0 
3 


as expected. Now using the following MATLAB script, we can determine the 
change in the location of the poles: 


% Unquantized parameters 

r = 0.9; theta = pi/3; al = -2*r*cos(theta); a2 = r*r; 

pi = r*exp(j*theta); p2 = pl’; 

% Quantized parameters: N = 3; 

[ahat ,L,B] = Qcoeff([a1,a2],3); rhat = sqrt(ahat(2)); 

thetahat = acos(-ahat(1)/(2*rhat)); pihat = rhat*exp(j*thetahat); p2 = pl’; 
% Changes in pole locations 

Dp1 = abs(pi-pihat) 

Dpi = 0.0344 


This is the same as before. 


EXAMPLE 6.26 Consider the following IIR filter with 10 poles closely packed at a radius of 
r = 0.9 around angles +45° with a separation of 5°. Due to large number of 
poles, the denominator coefficients have values that require 6 bits for the integer 
part. Using 9 bits for the fractional part for a total of 16-bit representation, we 
compute and plot the new locations of poles: 


r = 0.9; theta = (pi/180)*[-55:5:-35,35:5:55]’; 
r*xexp(j*theta); a = poly(p); b = 1; 


x 


Direct form: quantized coefficients 
N = 15; [ahat,L,B] = Qcoeff(a,N); 
TITLE = sprintf (’°%i-bit (1+%i+%i) Precision’ ,N+1,L,B); 


% Comparison of Pole-Zero Plots 

subplot(1,2,1); [HZ,HP,H1] = zplane(1,a); 

set (HZ,’color’,’g’,’linewidth’,1); set(HP,’color’,’g’,’linewidth’ ,1); 
set(H1,’color’,’w’?); axis([-1.1,1.1,-1.1,1.1]); 

title(’ Infinite Precision’, ’fontsize’,10,’fontweight’,’bold’); 
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Infinite Precision 16- bit (14649) Precision 


Imaginary Part 
Imaginary Part 


-1 -0.5 0 0.5 1 -1 —0.5 0 0.5 1 
Real Part Real Part 


FIGURE 6.31 Pole-zero plots for direct-form structure in Example 6.26 


subplot(1,2,2); [HZhat,HPhat,Hlhat] = zplane(1,ahat) ; 
set(HZhat,’color’,’r’,’linewidth’,1); set(HPhat,’color’,’r’,’linewidth’ ,1); 
set(Hlhat,’color’,’w’); title(TITLE, ’fontsize’ ,10,’fontweight’,’bold’) ; 
axis MEA lil il, i.5l))) 3 


Figure 6.31 shows the pole-zero plots for filters with both infinite and 16- 
bit precision coefficients. Clearly, with 16-bit word length, the resulting filter 
is completely different from the original one and is unstable. To investigate fi- 
nite word-length effect on the cascade-form structure, we first converted the 
direct-form coefficients into the cascade-form coefficients using the dir2cas 
function, quantized the resulting set of coefficients, and then converted back 
to the direct-form for pole-zero plotting. We show results for two different word 
lengths. In the first case, we used the same 16-bit word length. Since the cas- 
cade coefficients have smaller integer parts that require only one integer bit, 
the number of fractional bits is 14. In the second case we used 9 fractional bits 
(same as those in the direct form) for a total word length of 11 bits. 


% Cascade form: quantized coefficients: Same N 

[b0,B0,A0] = dir2cas(b,a); [BAhat1,L1,B1] = Qcoeff([BO,A0] ,N); 
TITLE1 = sprintf (’%i-bit (1+%i+%i) Precision’ ,N+1,L1,B1); 

Bhati = BAhati(:,1:3); Ahati = BAhati(:,4:6); 

[bhati,ahati] = cas2dir(b0,Bhat1,Ahat1) ; 


subplot(1,2,1); [HZhat1,HPhat1,Hlhati] = zplane(bhati,ahat1) ; 

set (HZhat1,’color’,’g’,’linewidth’,1); set(HPhat1,’color’,’g’,’linewidth’ ,1); 
set (Hlhat1,’color’,’w’); axis([-1.1,1.1,-1.1,1.1]); 

title(TITLE1,’fontsize’ ,10,’fontweight’,’bold’); 
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16- bit (1+1+14) Precision 11-bit (14+1+9) Precision 


Imaginary Part 
Imaginary Part 
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FIGURE 6.32 Pole-zero plots for cascade-form structure in Example 6.26 


% Cascade form: quantized coefficients: Same B (N=L1+B) 
N1 = L1+B; [BAhat2,L2,B2] = Qcoeff([BO,A0] ,N1); 

TITLE2 = sprintf (’%i-bit (1+%i+%i) Precision’ ,N1+1,L2,B2); 
Bhat2 = BAhat2(:,1:3); Ahat2 = BAhat2(:,4:6); 
[bhat2,ahat2] = cas2dir(b0,Bhat2,Ahat2) ; 


subplot(1,2,2); [HZhat2,HPhat2,Hlhat2] = zplane(bhat2,ahat2) ; 

set (HZhat2,’color’,’r’,’linewidth’ ,1); set(HPhat2,’color’,’r’,’linewidth’ ,1); 
set (Hlhat2,’color’,’w’);title(TITLE2, ’fontsize’ ,10, >fontweight’, ’bold’); 

axis (([al ili D 


The results are shown in Figure 6.32. We observe that not only for 16-bit rep- 
resentation but also for 11-bit representation, the resulting filter is essentially 
the same as the original one and is stable. Clearly, the cascade form structure 
has better finite word-length properties than the direct form structure. 


6.8.3 EFFECTS ON FREQUENCY RESPONSE 
The frequency response of the IIR filter in (6.50) is given by 
no be ew" 


N a 
1+ Xii ap C7 Iek 


H(e) = (6.76) 


When the coefficients {ap} and {bp} are quantized to {âp} and {bx}, 
respectively, the new frequency response is given by 
a Dino bx et 


H(e”) = 
( ) 1+ ie ak e— jek 


(6.77) 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Quantization of Filter Coefficients 281 


One can perform analysis similar to that for the movement of poles to 
obtain maximum change in the magnitude or phase responses due to 
changes in filter coefficients. However, such an analysis is very complicated 
and may not add any new insight. Hence we will study these effects using 
MATLAB. We provide the following two examples. 


EXAMPLE 6.27 Compute and plot magnitude responses of filter structures given for the filter 
in Example 6.26. 


Solution The filter is a bandpass filter with 10 tightly clustered poles implemented using 
the direct and the cascade forms. For the direct-form structure, we compute the 
magnitude response for infinite precision as well as for 16-bit quantization. For 
the cascade-form structure, we use 16-bit and 11-bit representations. 


r = 0.9; theta = (pi/180)*[-55:5:-35,35:5:55]’; 
p = r*xexp(j*theta); a = poly(p); b = 1; 
w = [0:500]*pi/500; H = freqz(b*1e-4,a,w); 


magH = abs(H); magHdb 


20*10g10 (magH) ; 


% Direct form: quantized coefficients 

N = 15; [ahat,L,B] = Qcoeff(a,N); 

TITLE = sprintf(’?/i-bit (1+%i+/i) Precision (DF)’,N+1,L,B); 
Hhat = freqz(b*le-4,ahat,w); magHhat = abs(Hhat) ; 


% Cascade form: quantized coefficients: Same N 

[b0,BO,A0] = dir2cas(b,a); 

[BAhat1,L1,B1] = Qcoeff([BO,A0] ,N); 

TITLE1 = sprintf(’%i-bit (1+%i+%i) Precision (CF)’,N+1,L1,B1); 
Bhati = BAhati(:,1:3); Ahati = BAhat1(:,4:6); 

[bhati,ahati] = cas2dir(b0,Bhati,Ahat1); 

Hhat1 = freqz(b*1e-4,ahat1,w); magHhati = abs(Hhat1); 


% Cascade form: quantized coefficients: Same B (N=L1+B) 

N1 = L1+B; [BAhat2,L2,B2] = Qcoeff([BO,A0] ,N1); 

TITLE2 = sprintf(’4%i-bit (1+%i+%i) Precision (CF)’,N1+1,L2,B2); 
Bhat2 = BAhat2(:,1:3); Ahat2 = BAhat2(:,4:6); 

[bhat2,ahat2] = cas2dir(b0,Bhat2,Ahat2) ; 

Hhat2 = freqz(b*1e-4,ahat2,w); magHhat2 = abs(Hhat2) ; 


% Comparison of Magnitude Plots 

Hf_1 = figure(’paperunits’,’inches’,’paperposition’,[0,0,6,4]); 
subplot(2,2,1); plot(w/pi,magH,’g’,’linewidth’,2); axis([0,1,0,0.7]); 
%xlabel(’Digital Frequency in \pi units’,’fontsize’,10); 
ylabel(’Magnitude Response’ ,’fontsize’ ,10) ; 

title(’Infinite Precision (DF)’,’fontsize’ ,10,’fontweight’ ,’ bold’); 
subplot (2,2,2); plot(w/pi,magHhat,’r’,’linewidth’,2); axis([0,1,0,0.7]); 
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#xlabel(’Digital Frequency in \pi units’,’fontsize’,10); 
ylabel(’Magnitude Response’ ,’fontsize’ ,10) ; 

title(TITLE, ’fontsize’,10, >fontweight’, >bold’); 

subplot (2,2,3); plot(w/pi,magHhat1,’r’,’linewidth’,2); axis([0,1,0,0.7]); 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’,10); 

ylabel(’Magnitude Response’ ,’fontsize’ ,10) ; 

title(TITLE1,’fontsize’ ,10, *fontweight’, *bold’); 

subplot (2,2,4); plot(w/pi,magHhat2,’r’,’linewidth’,2); axis([0,1,0,0.7]); 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’,10); 

ylabel(’Magnitude Response’ ,’fontsize’ ,10) ; 

title(TITLE2, ’fontsize’ ,10, *fontweight’, *bold’); 


The plots are shown in Figure 6.33. The top row shows plots for the direct 
form, and the bottom row shows those for the cascade form. As expected, the 
magnitude plot of the direct form is severely distorted for 16-bit representation, 
while those for the cascade form are preserved even for 11-bit word length. 


EXAMPLE 6.28 An 8th-order bandpass filter was obtained using the elliptic filter design ap- 
proach. This and other design methods will be discussed in Chapter 8. The 
MATLAB functions needed for this design are shown in the following script. 
This design produces direct-form filter coefficients bk and ax, using 64-bit 
floating-point arithmetic, which gives the precision of 15 decimals and hence 
can be considered as unquantized coefficients. Table 6.1 shows these filter 
coefficients. 
Represent the unquantized filter coefficients using 16-bit and 8-bit word 
lengths. Plot the filter log-magnitude responses and pole-zero locations for both 
the infinite and finite word-length coefficients. 


TABLE 6.1 Unquantized IIR filter coefficients used in Example 6.28 


k bk Qk 

0 0.021985541264351 1.000000000000000 
1 0.000000000000000 —0.000000000000004 
2 —0.032498273955222 2.344233276056572 
3 0.000000000000000 —0.000000000000003 
4 0.046424673058794 2.6898686 16770005 
5 0.000000000000000 0.000000000000001 
6 —0.032498273955221 1.584557559015230 
7 0.000000000000000 0.000000000000001 
8 0.021985541264351 0.413275250482975 
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Infinite Precision (DF) 16- bit (1+6+9) Precision (DF) 
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FIGURE 6.33 Magnitude plots for direct- and cascade-form structures in Exam- 
ple 6.27 
Solution Unlike the previous example, some of the filter coefficient values (specifically 


those of the autoregressive part) are greater than one and hence require bits for 
the integer part. This assignment is done for all coefficients since in practice, 
the same bit-pattern is used for the filter representation. These and other steps 
are given in the following MATLAB script. 


% The following 3 lines produce filter coefficients shown in Table 6.1. 
wp = [0.35,0.65]; ws = [0.25,0.75]; Rp = 1; As = 50; 

[N, wn] = ellipord(wp, ws, Rp, As); 

[b,a] = ellip(N,Rp,As,wn) ; 

w = [0:500]*pi/500; H = freqz(b,a,w); magH = abs(H); 

magHdb = 20*1og10(magH) ; 


% 16-bit word-length quantization 

N1 = 15; [bahat,L1,B1] = QCoeff([b;a] ,N1); 

TITLE1 = sprintf(’%i-bits (1+%i+%i)’ ,N1+1,L1,B41) ; 
bhati = bahat(1,:); ahati = bahat(2,:); 

Hhat1 = freqz(bhat1,ahati,w); magHhat1 = abs(Hhat1); 
magHhatidb = 20*log10(magHhat1); zhat1i = roots(bhat1) ; 
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% 8-bit word-length quantization 

N2 = 7; [bahat,L2,B2] = QCoeff([b;a] ,N2); 

TITLE2 = sprintf(’%i-bits (1+%i+%i)’ ,N2+1,L2,B2) ; 
bhat2 = bahat(1,:); ahat2 = bahat(2,:); 

Hhat2 = freqz(bhat2,ahat2,w); magHhat2 = abs(Hhat2) ; 
magHhat2db = 20*log10(magHhat2); zhat2 = roots(bhat2) ; 


%, Plots 
Hf_1 = figure(’paperunits’,’inches’,’paperposition’,[0,0,6,5]); 


% Comparison of Log-Magnitude Responses: 16 bits 

subplot (2,2,1); plot(w/pi,magHdb,’g’,’linewidth’,1.5); axis([0,1,-80,5]); 
hold on; plot(w/pi,magHhatidb,’r’,’linewidth’,1); hold off; 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’ ,10); 

ylabel(’Decibels’ ,’fontsize’ ,10) ; 

title([’Log-Mag plot: ’ ,TITLE1],’fontsize’ ,10,’fontweight’,’bold’); 


% Comparison of Pole-Zero Plots: 16 bits 

subplot (2,2,3); [HZ,HP,H1] = zplane([b],[a]); axis([-2,2,-2,2]); hold on; 
set (HZ,’color’,’g’,’linewidth’,1,’markersize’ ,4) ; 

set (HP,’color’,’g’,’linewidth’ ,1,’markersize’ ,4) ; 

plot (real(zhat1) ,imag(zhat1),’r+’,’linewidth’ ,1); 

title([’PZ Plot: ’,TITLE1],’fontsize’,10,’fontweight’,’bold’) ; 

hold off; 


% Comparison of Log-Magnitude Responses: 8 bits 

subplot (2,2,2); plot(w/pi,magHdb,’g’,’linewidth’,1.5); axis([0,1,-80,5]); 
hold on; plot(w/pi,magHhat2db,’r’,’linewidth’,1); hold off; 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’ ,10); 

ylabel(’Decibels’ ,’fontsize’ ,10) ; 

title([’Log-Mag plot: ’ ,TITLE2],’fontsize’ ,10,’fontweight’,’bold’); 


% Comparison of Pole-Zero Plots: 8 bits 

subplot (2,2,4); [HZ,HP,H1] = zplane([b],[a]); axis([-2,2,-2,2]); hold on; 
set (HZ,’color’,’g’,’linewidth’,1,’markersize’ ,4) ; 

set (HP,’color’,’g’,’linewidth’,1,’markersize’ ,4); 

plot (real (zhat2) ,imag(zhat2) ,’r+’,’ linewidth’ ,1); 

title([’PZ Plot: ’,TITLE2],’fontsize’,10,’fontweight’,’bold’) ; 

hold off; 


The log-magnitude responses and zero-pole locations of the resulting filters are 
plotted in Figure 6.34 along with those of the original filter. When 16 bits 
are used, the resulting filter is virtually indistinguishable from the original one. 
However, when 8 bits are used, the filter behavior is severely distorted. The filter 
is still stable, but it does not satisfy the design specifications. 
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FIGURE 6.34 Plots for the IIR filter in Example 6.28 


6.8.4 FIR FILTERS 
A similar analysis can be done for FIR filters. Let the impulse response 
of an FIR filter be h(n) with system response 


M-1 


H(z) = So h(n)2z™ (6.78) 
n=0 


Then, 
M-1 
AH(z) = X. Ah(n)z (6.79) 
n=0 
where AH(z) is the change due to change in the impulse response h(n). 
Hence 
M-1 M-1 
AH (e) = 5 Ah(n)e 7" or |AH(e%”)| < 5 |Ah(n)| (6.80) 
n=0 n=0 
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Now, if each coefficient is quantized to B fraction bits (i.e., total register 
length is B + 1), then, 


|An(n)| < 52-8 


Therefore, 
M 


1 
|AH(e”)| < 52M = ae (6.81) 
Thus, the change in frequency response depends not only on the number 
of bits used but also on the length M of the filter. For large M and small 
b, this difference can be significant and can destroy the desirable behavior 
of the filter, as we see in the following example. 


EXAMPLE 6.29 An order-30 lowpass FIR filter is designed using the firpm function. This and 
other FIR filter design functions will be discussed in Chapter 7. The resulting 
filter coefficients are symmetric and are shown in Table 6.2. We will consider 
these coefficients as essentially unquantized. The coefficients are quantized to 
16 bits (15 fractional plus 1 sign bit) and to 8 bits (7 fractional and 1 sign bit). 
The resulting filter frequency responses and pole-zero plots are determined and 
compared. These and other relevant steps are shown in the following MATLAB 
script. 


TABLE 6.2 Unquantized FIR filter coefficients used in 
Example 6.29 


k bk k 
0 0.000199512328641 30 
1 —0.002708453461401 29 
2 —0.002400461099957 28 
3 0.003546543555809 27 
4 0.008266607456720 26 
5 0.000012109690648 25 
6 —0.015608300819736 24 
7 —0.012905580320708 23 
8 0.017047710292001 22 
9 0.036435951059014 21 
10 0.000019292305776 20 
11 —0.065652005307521 19 
12 —0.057621325403582 18 
13 0.090301607282890 17 
14 0.300096964940136 16 
15 0.400022084144842 15 


% The following function computes the filter 
% coefficients given in Table 6.2. 
b = firpm(30, [0,0.3,0.5,1],[1,1,0,0]); 
w = [0:500]*pi/500; H = freqz(b,1,w); magH = abs(H); 
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magHdb = 20*1og10(magH) ; 

N1 = 15; [bhati,L1,B1] = Qcoeff(b,N1); 

TITLE1 = sprintf(’%i-bits (1+%i+%i)’,N1+1,L1,B4) ; 
Hhat1 = freqz(bhat1,1,w); magHhati = abs(Hhat1) ; 
magHhatidb = 20*log10(magHhat1) ; 

zhati = roots(bhat1) ; 


N2 = 7; [bhat2,L2,B2] = Qcoeff(b,N2); 

TITLE2 = sprintf(’%i-bits (1+%i+%i)’ ,N2+1,L2,B2) ; 
Hhat2 = freqz(bhat2,1,w); magHhat2 = abs(Hhat2) ; 
magHhat2db = 20*1og10(magHhat2) ; 

zhat2 = roots(bhat2) ; 


%, Plots 
Hf_1 = figure(’paperunits’,’inches’,’paperposition’,[0,0,6,5]); 


% Comparison of Log-Magnitude Responses: 16 bits 

subplot(2,2,1); plot(w/pi,magHdb,’g’,’linewidth’,1.5); axis([0,1,-80,5]); 
hold on; plot(w/pi,magHhatidb,’r’,’linewidth’,1); hold off; 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’,10); 

ylabel(’Decibels’ ,’fontsize’ ,10) ; 

title([’Log-Mag plot: ’ ,TITLE1],’fontsize’ ,10,’fontweight’,’bold’); 


% Comparison of Pole-Zero Plots: 16 bits 

subplot (2,2,3); [HZ,HP,H1] = zplane([b],[1]); axis([-2,2,-2,2]); hold on; 
set (HZ,’color’,’g’,’linewidth’ ,1,’markersize’ ,4) ; 

set (HP,’color’,’g’,’linewidth’,1,’markersize’ ,4) ; 

plot (real(zhat1) ,imag(zhat1),’r+’,’linewidth’ ,1); 

title([’PZ Plot: ’,TITLE1],’fontsize’,10,’fontweight’,’bold’); 

hold off; 


% Comparison of Log-Magnitude Responses: 8 bits 

subplot(2,2,2); plot(w/pi,magHdb,’g’,’linewidth’,1.5); axis([0,1,-80,5]); 
hold on; plot(w/pi,magHhat2db,’r’,’linewidth’,1); hold off; 
xlabel(’Digital Frequency in \pi units’ ,’fontsize’ ,10); 

ylabel(’Decibels’ ,’fontsize’ ,10) ; 

title([’Log-Mag plot: ’ ,TITLE2],’fontsize’ ,10,’fontweight’,’bold’); 


% Comparison of Pole-Zero Plots: 8 bits 

subplot (2,2,4); [HZ,HP,H1] = zplane([b],[1]); axis([-2,2,-2,2]); hold on; 
set (HZ,’color’,’g’,’linewidth’,1,’markersize’ ,4); 

set (HP,’color’,’g’,’linewidth’,1,’markersize’ ,4); 

plot (real (zhat2) ,imag(zhat2) ,’r+’,’ linewidth’ ,1); 

title([’PZ Plot: ’,TITLE2],’fontsize’,10,’fontweight’,’bold’) ; 

hold off; 


The log-magnitude responses and zero-pole locations of the resulting filters are 
computed and plotted in Figure 6.35 along with those of the original filter. 
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FIGURE 6.35 Plots for the FIR filter in Example 6.29 


When 16 bits are used, the resulting filter is virtually indistinguishable from 
the original one. However, when 8 bits are used, the filter behavior is severely 
distorted and the filter does not satisfy the design specifications. 


6.9 PROBLEMS 
—— gp 


P6.1 Draw direct form I block diagram structures for each of the following LTI systems with 
input node x(n) and output node y(n). 


1. y(n) = x(n) + 2a(n — 1) + 3z(n — 2) 


1 
AANA) =e ri = 06S 
3. y(n) = 1L.7y(n — 1) — 1.36 y(n — 2) + 0.576 y(n — 3) + x(n) 
4. y(n) = 1.6 y(n — 1) + 0.64 y(n — 2) + a(n) + 22(n — 1) + x(n — 2) 
132-3432" 423 
~ 1+0.22-! — 0.142-2 4 0.4477 


5. H(z) 
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FIGURE P6.1 Block diagrams for Problem 6.2 


P6.2 Two block diagrams are shown in Figure P6.1. Answer the following for each structure. 


1. Determine the system function H(z) = Y(z)/X(z). 

2. Is the structure canonical (i.e., with the least number of delays)? If not, draw a 
canonical structure. 

3. Determine the value of K so that H(e?°) = 1. 


P6.3 Consider the LTI system described by 
y(n) = ay(n— 1) + ba(n) (6.82) 


1. Draw a block diagram of this system with input node x(n) and output node y(n). 

2. Now perform the following two operations on the structure drawn in part 1: (i) reverse 
all arrow directions and (ii) interchange the input node with the output node. Notice 
that the branch node becomes the adder node and vice versa. Redraw the block diagram 
so that input node is on the left side and the output node is on the right side. This is the 
transposed block diagram. 

3. Determine the difference equation representation of your transposed structure in part 2, 
and verify that it is the same equation as (6.82). 


P6.4 Consider the LTI system given by 


_ 1 = 2.818271 +. 3.97277 — 2.818027? + 274 
1 — 2.536271 + 3.2152-2 — 2.0542-3 + 0.65602~4 


H(z) (6.83) 


1. Draw the normal direct form I structure block diagram. 

2. Draw the transposed direct form I structure block diagram. 

3. Draw the normal direct form II structure block diagram. Observe that it looks very 
similar to that in part 2. 

4. Draw the transposed direct form II structure block diagram. Observe that it looks very 
similar to that in part 1. 


P6.5 Consider the LTI system given in Problem P6.4. 


1. Draw a cascade structure containing 2nd-order normal direct-form-II sections. 
Draw a cascade structure containing 2nd-order transposed direct-form-II sections. 
Draw a parallel structure containing 2nd-order normal direct-form-II sections. 
Draw a parallel structure containing 2nd-order transposed direct-form-II sections. 


te NS 
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P6.6 A causal linear time-invariant system is described by 


4 5 


y(n) = X` cos(0.1k)a(n — k) — X` (0.8)* sin(0.1rk)y(n — k) 


k=0 k=1 


Determine and draw the block diagrams of the following structures. Compute the response 
of the system to 


in each case, using the following structures. 


1. Normal direct form I 

Transposed direct form IT 

Cascade form containing 2nd-order normal direct-form-II sections 
Parallel form containing 2nd-order transposed direct-form-II sections 
Lattice-ladder form 


Sey Conte. 


P6.7 An IIR filter is described by the following system function 


H(2)=2 1 +027! +27? ; Faget 1227! +27? 
1— 0.82771 + 0.64772) ` \1—0.75271 J ` 1 + 0.812772 


Determine and draw the following structures. 


Transposed direct form I 

Normal direct form II 

Cascade form containing transposed 2nd-order direct-form-II sections 
Parallel form containing normal 2nd-order direct-form-II sections 
Lattice-ladder form 


SER CONN 


P6.8 An IIR filter is described by the following system function 


oe —14.75 — 12.927} \ , (24.5 + 26.82271 \ (142271427? 
DoE ee 140.817? 


Determine and draw the following structures: 


Normal direct form I 

Normal direct form II 

Cascade form containing transposed 2nd-order direct-form-II sections 
Parallel form containing transposed 2nd-order direct-form-II sections 
Lattice-ladder form 


Ce ROO Nr 
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FIGURE P6.2 Structure for Problem 6.9 


P6.9 Figure P6.2 describes a causal linear time-invariant system. Determine and draw the 
following structures: 


1. Direct form I 
2. Direct form II 


3. Cascade form containing second-order direct-form-II sections 
4. Parallel form containing second-order direct-form-II sections 


P6.10 A linear time-invariant system with system function 


H(z) = 0.05 — 0.0127} — 0.1327? + 0.13274 + 0.0127" — 0.052~° 
1 — 0.77271 + 1.59272 — 0.88273 + 1.224 — 0.352-5 + 0.31276 


is to be implemented using a flow graph of the form shown in Figure P6.3. 


1. Fill in all the coefficients in the diagram. 
2. Is your solution unique? Explain. 


FIGURE P6.3 Structure for Problem 6.10 


P6.11 A linear time-invariant system with system function 


H(2) = 0.051 + 0.08827" + 0.0627? — 0.02927? — 0.069274 — 0.046z7° 
1 — 1.34271 + 1.478z-? — 0.7892-3 + 0.2322-4 


is to be implemented using a flow graph of the form shown in Figure P6.4. Fill in all the 
coefficients in the diagram. 
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FIGURE P6.4 Problem for Problem 6.11 


P6.12 Consider the linear time-invariant system given in Problem P6.10. 


0.05 — 0.0127! — 0.1327? + 0.13274 + 0.0127° — 0.05276 


H(z) = : 
(2) 1 — 0.7727} + 1.592-? — 0.88273 + 1.2274 — 0.35275 + 0.31276 


It is to be implemented using a flow graph of the form shown in Figure P6.5. 


1. Fill in all the coefficients in the diagram. 
2. Is your solution unique? Explain. 


x(n) 


FIGURE P6.5 Structure for Problem 6.12 


P6.13 The filter structure shown in Figure P6.6 contains a parallel connection of cascade sections. 
Determine and draw the overall 


1. direct form (normal) structure, 
2. direct form (transposed) structure, 
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FIGURE P6.6 Structure for Problem 6.13 


3. cascade form structure containing 2nd-order sections, 
4. parallel form structure containing 2nd-order sections. 


P6.14 In filter structure shown in Figure P6.7, systems Hı(z) and H2(z) are subcomponents of a 
larger system H(z). The system function H1(z) is given in the parallel form 


0.2—0.3271 0.4 + 0.52771 
1+0.92-1+0.92-2 ` 1—0.82-! + 0.8272 


and the system function H2(z) is given in the cascade form 


Jae ta go? 3442714527? 
H(z) = z1 Z2 ZI = 
1+ 1.727! + 0.722 1 — 1.5271 + 0.562 
1. Express H(z) as a rational function. 


2. Draw the block diagram of H(z) as a cascade-form structure. 
3. Draw the block diagram of H(z) as a parallel-form structure. 


FIGURE P6.7 Structure for Problem 6.14 
P6.15 The digital filter structure shown in Figure P6.8 is a cascade of 2 parallel sections and 
corresponds to a 10th-order IIR digital filter system function 


_ 1—2.2z7? + 1.6368274 — 0.489282z~° + 5395456 x 1078278 — 147456 x 1078271? 
1 — 1.65272 + 0.8778z74 — 0.17281z~ + 1057221 x 1078278 — 893025 x 10-10z-10 
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FIGURE P6.8 Structure for Problem 6.15 


1. Due to an error in labeling, two of the multiplier coefficients (rounded to 4 decimals) in 
this structure have incorrect values. Locate these 2 multipliers and determine their 
correct values. 

2. Determine and draw an overall cascade structure containing 2nd-order section and which 
contains the least number of multipliers. 


P6.16 As described in this chapter, a linear-phase FIR filter is obtained by requiring certain 
symmetry conditions on its impulse responses. 


1. In the case of symmetrical impulse response, we have h(n) = h(M —1-—n), 
0<n< M —1. Show that the resulting phase response is linear in w and is given by 


LH (e) (Fe T<w<n 


2. Draw the linear-phase structures for this form when M = 5 and M = 6. 
3. In the case of antisymmetrical impulse response, we have h(n) = —h(M -1 - n), 
0<n< M —1. Show that the resulting phase response is given by 


LH (e%”) 5 (FFs T<w<t 


4. Draw the linear-phase structures for this form when M = 5 and M = 6. 


P6.17 An FIR filter is described by the difference equation 


6 


y(n) = y eTl- e(n ma k) 


k=0 


Determine and draw the block diagrams of the following structures. 
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Direct form 
Linear-phase form 
Cascade form 

4. Frequency sampling form 


Gor 


P6.18 A linear time-invariant system is given by the system function 


Determine and draw the block diagrams of the following structures. 


1. Direct form 

2. Cascade form 

3. Lattice form 

4. Frequency sampling form 


P6.19 Using the conjugate symmetry property of the DFT 


= H (0), k=0 
ooo k=1,...,M—1 


and the conjugate symmetry property of the wg factor, show that (6.12) can be put in 
the form (6.13) and (6.14) for real FIR filters. 


P6.20 To avoid poles on the unit circle in the frequency sampling structure, one samples H(z) at 
zk = rel2Th/M k =0,..., M — 1 where r ~ 1(but < 1), as discussed in Section 6.3. 
1. Using 
H (ret?) ~ H (k), 


show that the frequency-sampling structure is given by 


age co HSW m 20 _ H(M/2) 


= rz! 1l+rz-1 


where 


cos [ZH (k)] — rz~* cos [ZH (k) — RTE] 


H, (z) = Mio k=1,...,L 
r (2) 1 — 2rz- 1 cos (2E) + r2z ae 


and M is even. 
2. Modify the MATLAB function dir2fs (which was developed in Section 6.3) to 
implement this frequency-sampling form. The format of this function should be 
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[C,B,A,rM] = dir2fs(h,r) 
% Direct form to Frequency Sampling form conversion 


% [C,B,A,rM] = dir2fs(h,r) 

% C = Row vector containing gains for parallel sections 

% B = Matrix containing numerator coefficients arranged in rows 

% A = Matrix containing denominator coefficients arranged in rows 
i rM = r^M factor needed in the feedforward loop 

% h = impulse response vector of an FIR filter 

% xr = radius of the circle over which samples are taken (r<1) 


3. Determine the frequency sampling structure for the impulse response given in Example 
6.6 using this function. 


P6.21 Determine the impulse response of an FIR filter with lattice parameters 
Ko=2, Ki =0.6, K2=0.3, K3=0.5, Ks =0.9 


Draw the direct form and lattice form structures of this filter. 


P6.22 Consider the following system function of an FIR filter 


H(z) = 1 — 4271 + 6.427? — 5.12273 + 2.048274 — 0.327682" 


1. Provide block diagram structures in the following forms: 


(a) Normal and transposed direct forms 

(b) Cascade of five 1st-order sections 

(c) Cascade of one 1st-order section and two 2nd-order sections 
(d) Cascade of one 2nd-order section and one 3rd-order section 
( 


e) Frequency-sampling structure with real coefficients 


2. The computational complexity of a digital filter structure can be given by the total 
number of multiplications and the total number of 2-input additions that are required 
per output point. Assume that x(n) is real and that multiplication by 1 is not counted 
as a multiplication. Compare the computational complexity of each of these structures. 


P6.23 A causal digital filter is described by the following zeros: 
A= 0.5 60° Z2 = 0.5 e760" | 23 = 2 e760" ZA = 2 e7160 
25 =0.25e, z6=0.25e778, zy =A exp = 4 9°, 


and poles: {p;}8_,; = 

Determine the phase response of this filter, and show that it is a linear-phase FIR filter. 
Determine the impulse response of the filter. 

Draw a block diagram of the filter structure in the direct form. 

Draw a block diagram of the filter structure in the linear-phase form. 


CS 
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P6.24 MATLAB provides the built-in functions dec2bin and bin2dec to convert non-negative 
decimal integers into binary codes and vice versa, respectively. 


1. Develop a function B = sm2bin(D) to convert a sign-magnitude format decimal integer D 
into its binary representation B. Verify your function on the following numbers: 


(a) D=1001 (b) D=-63 (c) D=-449 (d) D=978 (e) D = —205 


2. Develop a function D = bin2sm(B) to convert a binary representation B into its sign- 
magnitude format decimal integer D. Verify your function on the following 


representations: 
(a) B = 1010 (b) B = 011011011 (c) B = 11001 
(d) B = 1010101 (e) B = 011011 


P6.25 Using the function TwosComplement as a model, develop a function y = TensComplement 
(x,N) that converts a sign-magnitude format integer x into the N-digit ten’s-complement 
integer y. 


1. Verify your function using the following integers: 


(a) £ = 1234, N = 6 (b) z = —603, N = 4 (c) x = —843, N = 5 
(d) x = —1978, N = 6 (e) z = 50, N = 3 


2. Using the ten’s-complement format, perform the following arithmetic operations. In each 
case, choose an appropriate value on N for the meaningful result. 


(a) 123 + 456 — 789 (b) 648 + 836 — 452 (c) 2001 + 3756 
(d) —968 + 4539 (e) 888 — 666 + 777 


Verify your results using decimal operations. 


P6.26 The function OnesComplement developed in this chapter converts signed integers into one’s- 
complement format decimal representations. In this problem we will develop functions that 
will operate on fractional numbers. 


1. Develop a MATLAB function y = sm2oc(x, B) that converts the sign-magnitude format 
fraction x into the B-bit 1s-complement format decimal equivalent number y. Verify 
your function on the following numbers. In each case the numbers to be considered are 
both positive and negative. Also, in each case select the appropriate number of bits B. 


(a) £ = £0.5625 (b) £ = +0.40625 (c) £ = +0.953125 
(d) x = +0.1328125 (e) £ = +0.7314453125 


2. Develop a MATLAB function x = oc2sm(y, B) that converts the B-bit one’s-complement 
format decimal equivalent number y into the sign-magnitude format fraction x. Verify 
your function on the following fractional binary representations: 


(a) y = 1410110 (b) y = 0.4 011001 (c) y = 1400110011 
(d) y = 1411101110 (e) y = 0400010001 


P6.27 The function TwosComplement developed in this chapter converts signed integers into two’s- 
complement format decimal representations. In this problem we will develop functions that 
will operate on fractional numbers. 


1. Develop a MATLAB function y = sm2tc(x, B) that converts the sign-magnitude format 
fraction x into the B-bit two’s-complement format decimal equivalent number y. Verify 
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your function on the following numbers. In each case the numbers to be considered are 
both positive and negative. Also, in each case select the appropriate number of bits B. 


(a) £ = £0.5625 (b) £ = +0.40625 (c) £ = +0.953125 
(d) z = +0.1328125 (£) £ = +0.7314453125 


Compare your representations with those in Problem P6.26, part 1. 

2. Develop a MATLAB function x = tc2sm(y, B) that converts the B-bit two’s-complement 
format decimal equivalent number y into the sign-magnitude format fraction x. Verify 
your function on the following fractional binary representations: 


(a) y = 1410110 (b) y = 0.4011001 (c) y = 1400110011 
(d) y = 1411101110 (e) y = 0400010001 


Compare your representations with those in Problem P6.26, part 2. 


P6.28 Determine the 10-bit sign-magnitude, one’s-complement, and two’s-complement 
representation of the following decimal numbers: 


(a) 0.12345 (b) —0.56789 (c) 0.38452386 (d) —0.762349 (e) —0.90625 
P6.29 Consider a 32-bit floating-point number representation with a 6-bit exponent and a 25-bit 
mantissa. 


1. Determine the value of the smallest number that can be represented. 

2. Determine the value of the largest number that can be represented. 

3. Determine the dynamic range of this floating-point representation and compare it with 
the dynamic range of a 32-bit fixed-point signed integer representation. 


P6.30 Show that the magnitudes of floating-point numbers in a 32-bit IEEE standard range from 
1.18 x 107** to 3.4 x 10°°. 


P6.31 Compute and plot the truncation error characteristics when B = 4 for the sign-magnitude, 
one’s-complement, and two’s-complement formats. 


P6.32 Consider the 3rd-order elliptic lowpass filter: 
0.1214 (1 — 1.421127" + 277) (14277) 
(1 — 1.49282z-! + 0.8612z-2) (1 — 0.6183z-1) 


1. If the filter is realized using a direct-form structure, determine its pole sensitivity. 
2. If the filter is realized using a cascade-form structure, determine its pole sensitivity. 


H(z) = 


P6.33 Consider the filter described by the difference equation 


— J 

y(n) o a 1) — a(n) + V2z(n — 1) (6.84) 

1. Show that this filter is an all-pass filter (i.e., |H(e’”)|) is a constant over the entire 
frequency range —r < w < m. Verify your answer by plotting the magnitude response 
|H(e?”)| over the normalized frequency range 0 < w/m < 1. Use subplot (3,1,1). 

2. Round the coefficients of the difference equation in (6.84) to 3 decimals. Is the filter still 
all-pass? Verify your answer by plotting the resulting magnitude response, |Hi(e”)|, 
over the normalized frequency range 0 < w/a < 1. Use subplot (3,1,2). 

3. Round the coefficients of the difference equation in (6.84) to 2 decimals. Is the filter still 
all-pass? Verify your answer by plotting the resulting magnitude response, |H2(e”)|, 
over the normalized frequency range 0 < w/a < 1. Use subplot (3,1,3). 
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4. Explain why the magnitude |A,(e%”)| is “different” from the magnitude |H2(e”)|. 


P6.34 An IIR lowpass filter designed to meet the specifications of 0.5 dB ripple in the passband, 
60 dB ripple in the stopband, a passband edge frequency wp = 0.257, and a stopband edge 
frequency ws = 0.37 is obtained using the following MATLAB script: 


wp = 0.25*pi; ws = 0.3*pi; Rp = 0.5; As = 60; 
[N, Wn] = ellipord(wp/pi, ws/pi, Rp, As); 
[b,a] = ellip(N,Rp,As,Wn) ; 


The filter coefficients b and a, are in the arrays b and a, respectively, and can be 
considered to have infinite precision. 


1. Using infinite precision, plot the log-magnitude and phase responses of the designed 
filter. Use two rows and one column of subplots. 

2. Quantize the direct-form coefficients to 4 decimals (by rounding). Now plot the 
log-magnitude and phase responses of the resulting filter. Use 2 rows and 1 column of 
subplots. 

3. Quantize the direct form coefficients to 3 decimals (by rounding). Now plot the 
log-magnitude and phase responses of the resulting filter. Use 2 rows and 1 column of 
subplots. 

4. Comment on the plots in parts 1, 2, and 3. 


P6.35 Consider the digital lowpass filter used in Problem P6.34. 


1. Using infinite precision and cascade-form realization, plot the log-magnitude and phase 
responses of the designed filter. Use two rows and one column of subplots. 

2. Quantize the cascade-form coefficients to 4 decimals (by rounding). Now plot the 
log-magnitude and phase responses of the resulting filter. Use two rows and one column 
of subplots. 

3. Quantize the cascade-form coefficients to 3 decimals (by rounding). Now plot the 
log-magnitude and phase responses of the resulting filter. Use two rows and one column 
of subplots. 

4. Comment on the plots in the above three parts and compare them with the similar plots 
in Problem P6.34. 


P6.36 A length-32 linear-phase FIR bandpass filter that satisfies the requirements of 60 dB 
stopband attenuation, lower stopband edge frequency ws, = 0.27, and upper stopband edge 
frequency ws, = 0.87 is obtained using the following MATLAB script. 


wsi = 0.2*pi; ws2 = 0.8*pi; As = 60; 

M = 32; Df = 0.2115; 

fp1 = wsi/pitDf; fp2 = ws2/pi-Df; 

h = firpm(M-1, [0,ws1/pi,fp1,fp2,ws2/pi,1],[0,0,1,1,0,0]); 


The filter impulse response h(n) is in the array h and can be considered to have infinite 
precision. 


1. Using infinite precision, plot the log-magnitude and amplitude responses of the designed 
filter. Use 2 rows and 1 column of subplots. 
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2. Quantize the direct-form coefficients to 4 decimals (by rounding). Now plot the 
log-magnitude and amplitude responses of the resulting filter. Use 2 rows and 1 column 
of subplots. 

3. Quantize the direct-form coefficients to 3 decimals (by rounding). Now plot the 
log-magnitude and amplitude responses of the resulting filter. Use 2 rows and 1 column 
of subplots. 

4. Comment on the plots in parts 1, 2, and 3. 

5. Based on the results of this problem, determine how many significant bits (and not 
decimals) are needed in practice to represent FIR direct form realizations. 


P6.37 The digital filter structure shown in Figure P6.9 is a cascade of 2 parallel sections and 
corresponds to a 10th-order IIR digital filter system function 


1 — 2.227? + 1.63682~4 — 0.489282~° + 5395456 x 1078278 — 147456 x 1078 271° 
H(z) = 
1 — 1.652-2 + 0.87782-4 — 0.172812-§ + 1057221 x 10-8 2-8 — 893025 x 10-10z-10 
4.0635 4.0635 
> > 
-0.0793 -2.8255 
ore > di > a J ore > > > >—o 
A y zZ A y z 
-1.6 —0.0815 0.4 0.7747 
4 9 > e 4 > > 
A A y z! Y A A y zZ! Y 
-0.63 -0.03 
~¢ 4 
x(n) -0.5502 -0.2076 y(n) 
© >—_o—_>-@ > > > >—O_>_0_>-@ > > > >-o— > @ 
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-0.8 -0.2245 1.2 0.1319 
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FIGURE P6.9 Structure for Problem P6.37 


1. Due to an error in labeling, two of the multiplier coefficients (rounded to 4 decimals) in 
this structure have incorrect values. Locate these 2 multipliers and determine their 
correct values. 

2. By inspecting the pole locations of the system function H(z), you should realize that 
this structure is sensitive to the coefficient quantization. Suggest, with justification, an 
alternative structure that in your opinion is least sensitive to coefficient quantization. 
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P6.38 An IIR bandstop digital filter that satisfies the requirements: 


0.95 < |H(e?*)| < 1.05, 0 < |w| < 0.257 
0 < |H(e%”)| < 0.01, 0.357 < |w| < 0.657 
0.95 < |H(e’”)| < 1.05, 0.757 < |u| < a 


can be obtained using the following MATLAB script: 


wp = [0.25,0.75]; ws = [0.35,0.65]; deltal = 0.05; delta2 = 0.01; 
[Rp,As] = delta2db(delta1,delta2); 

[N, wn] cheb2ord(wp, ws, Rp, As); 

[b,a] = cheby2(N,As,wn,’ stop’); 


The filter coefficients bp and a, are in the arrays b and a, respectively, and can be 
considered to have infinite precision. 


1. Using infinite precision, provide the log-magnitude response plot and the pole-zero plot 
of the designed filter. 

2. Assuming direct-form structure and a 12-bit representation for filter coefficients, provide 
the log-magnitude response plot and the pole-zero plot of the designed filter. Use the 
Qcoeff function. 

3. Assuming cascade-form structure and a 12-bit representation for filter coefficients, 
provide the log-magnitude response plot and the pole-zero plot of the designed filter. Use 
the Qcoeff function. 


P6.39 An IIR lowpass digital filter that satisfies the specifications: 


passband edge: 0.47, Rp =0.5 dB 
stopband edge: 0.67, As = 50 dB 


can be obtained using the following MATLAB script: 


wp = 0.4; ws = 0.6; Rp = 0.5; As = 50; 
[N, wn] = buttord(wp, ws, Rp, As); 
[b,a] = butter(N,wn) ; 


The filter coefficients bp and a, are in the arrays b and a, respectively, and can be 
considered to have infinite precision. 


1. Using infinite precision, provide the magnitude response plot and the pole-zero plot of 
the designed filter. 

2. Assuming direct-form structure and a 10-bit representation for filter coefficients, provide 
the magnitude response plot and the pole-zero plot of the designed filter. Use the Qcoeff 
function. 

3. Assuming cascade-form structure and a 10-bit representation for filter coefficients, 
provide the magnitude response plot and the pole-zero plot of the designed filter. Use 
the Qcoeff function. 


P6.40 An IIR highpass digital filter that satisfies the specifications: 


stopband edge: 0.47, A; =60dB 
passband edge: 0.67, Rp =0.5 dB 
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can be obtained using the following MATLAB script: 


wp = 0.6; ws = 0.4; Rp = 0.5; As = 60; 
[N,wn] = ellipord(wp, ws, Rp, As); 
[b,a] = ellip(N,Rp,As,wn, ’high’) ; 


The filter coefficients bp and a, are in the arrays b and a, respectively, and can be 
considered to have infinite precision. 


1. Using infinite precision, provide the magnitude response plot and the pole-zero plot of 
the designed filter. 

2. Assuming direct-form structure and a 10-bit representation for filter coefficients, provide 
the magnitude response plot and the pole-zero plot of the designed filter. Use the Qcoeff 
function. 

3. Assuming parallel-form structure and a 10-bit representation for filter coefficients, 
provide the magnitude response plot and the pole-zero plot of the designed filter. Use 
the Qcoeff function. 


P6.41 A bandstop linear-phase FIR filter that satisfies the specifications: 


lower stopband edge: 0.47 
upper stopband edge: 0.67 
lower passband edge: 0.37 
upper passband edge: 0.77 


As = 50 dB 
Rp = 0.2 dB 
can be obtained using the following MATLAB script: 


wpl = 0.3; wsi = 0.4; ws2 = 0.6; wp2 = 0.7; Rp = 0.2; As = 50; 

[delta1,delta2] = db2delta(Rp,As) ; 

b = firpm(44, [0,wp1,wsi,ws2,wp2,1],[1,1,0,0,1,1],... 
[delta2/deltai,1,delta2/delta1]); 


The filter impulse response h(n) is in the array b and can be considered to have infinite 
precision. 


P6.42 A bandpass linear-phase FIR filter that satisfies the specifications: 


0 < |A(e’*)| < 0.01, 0 < w < 0.257 
0.95 < |H(e’*)| < 1.05, 0.35m < w < 0.657 
0 < |A(e”)| < 0.01, 0.757 <w <r 


can be obtained using the following MATLAB script: 


wsi = 0.25; wp1 = 0.35; wp2 = 0.65; ws2 = 0.75; 

deltal = 0.05; delta2 = 0.01; 

b = firpm(40, [0,ws1,wp1,wp2,ws2,1],[0,0,1,1,0,0],... 
[1,delta2/deltai,1]); 


The filter impulse response h(n) is in the array b and can be considered to have infinite 
precision. 
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CHAPTER 


FIR Filter 
Design 


We now turn our attention to the inverse problem of designing systems 
from the given specifications. It is an important as well as a difficult 
problem. In digital signal processing there are two important types of 
systems. The first type of systems perform signal filtering in the time 
domain and hence are called digital filters. The second type of systems 
provide signal representation in the frequency domain and are called 
spectrum analyzers. In Chapter 5 we described signal representations 
using the DFT. In this and the next chapter we will study several basic 
design algorithms for both FIR and IIR filters. These designs are mostly 
of the frequency selective type; that is, we will design primarily multiband 
lowpass, highpass, bandpass, and bandstop filters. In FIR filter design 
we will also consider systems like differentiators or Hilbert transformers, 
which, although not frequency-selective filters, nevertheless follow the 
design techniques being considered. More sophisticated filter designs are 
based on arbitrary frequency-domain specifications and require tools that 
are beyond the scope of this book. 

We first begin with some preliminary issues related to design philos- 
ophy and design specifications. These issues are applicable to both FIR 
and IIR filter designs. We will then study FIR filter design algorithms in 
the rest of this chapter. In Chapter 8 we will provide a similar treatment 
for IIR filters. 


303 
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7.1 PRELIMINARIES 
—— gp 


The design of a digital filter is carried out in three steps: 


e Specifications: Before we can design a filter, we must have some spec- 
ifications. These specifications are determined by the applications. 


e Approximations: Once the specifications are defined, we use various 
concepts and mathematics that we studied so far to come up with a 
filter description that approximates the given set of specifications. This 
step is the topic of filter design. 

e Implementation: The product of the above step is a filter description 
in the form of either a difference equation, or a system function H(z), 
or an impulse response h(n). From this description we implement the 
filter in hardware or through software on a computer as we discussed 
in Chapter 6. 


In this and the next chapter we will discuss in detail only the second step, 
which is the conversion of specifications into a filter description. 

In many applications like speech or audio signal processing, digital 
filters are used to implement frequency-selective operations. Therefore, 
specifications are required in the frequency-domain in terms of the de- 
sired magnitude and phase response of the filter. Generally a linear phase 
response in the passband is desirable. In the case of FIR filters, it is pos- 
sible to have exact linear phase as we have seen in Chapter 6. In the case 
of IIR filters a linear phase in the passband is not achievable. Hence we 
will consider magnitude-only specifications. 

The magnitude specifications are given in one of two ways. The first 
approach is called absolute specifications, which provide a set of require- 
ments on the magnitude response function |H(e%”)|. These specifications 
are generally used for FIR filters. IIR filters are specified in a somewhat 
different way, which we will discuss in Chapter 8. The second approach is 
called relative specifications, which provide requirements in decibels (dB), 
given by 

Ww 
dB scale = —20 logy, ee >0 
|H (e3”) | max 
This approach is the most popular one in practice and is used for both 
FIR and IIR filters. To illustrate these specifications, we will consider a 
lowpass filter design as an example. 


7.1.1 ABSOLUTE SPECIFICATIONS 

A typical absolute specification of a lowpass filter is shown in Figure 7.1a, 

in which 

e band [0, wp] is called the passband, and 6, is the tolerance (or ripple) 
that we are willing to accept in the ideal passband response, 
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FIGURE 7.1 FIR filter specifications: (a) absolute (b) relative 


e band [ws, 7] is called the stopband, and 69 is the corresponding tolerance 
(or ripple), and 

e band [w,, ws] is called the transition band, and there are no restrictions 
on the magnitude response in this band. 


7.1.2 RELATIVE (DB) SPECIFICATIONS 

A typical absolute specification of a lowpass filter is shown in Figure 7.1b, 
in which 

e Rp is the passband ripple in dB, and 

e A, is the stopband attenuation in dB. 


The parameters given in these two specifications are obviously related. 
Since |H(e?”)|max in absolute specifications is equal to (1 + 61), we have 


t= 
Rp = —20log49 eae > 0 (0) (7.1) 
and 5 
As = —20log,) —— 1 7.2 
Ologo pg > Oo ) (7.2) 


EXAMPLE 7.1 In a certain filter’s specifications the passband ripple is 0.25 dB, and the stop- 
band attenuation is 50 dB. Determine 6; and 62. 


Solution Using (7.1), we obtain 


— 61 


61 = 0.0144 
+ 61 : 


1 
Rp = 0.25 = —20 logy I 
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Using (7.2), we obtain 


As = 50 = —20log,, i a 


2 62 
= —201 59 = 0.0032 
A S107 50.0144.” 


EXAMPLE 7.2 Given the passband tolerance 6, = 0.01 and the stopband tolerance 62 = 0.001, 
determine the passband ripple Rp and the stopband attenuation As. 


Solution From (7.1) the passband ripple is 


1-6 
Rp = —20 log, cic = 0.1737 dB 


and from (7.2) the stopband attenuation is 


ê 
As = —20logyg ce = 60 dB 


Problem P7.1 develops MATLAB functions to convert one set of spec- 
ifications into another. 

These specifications were given for a lowpass filter. Similar specifica- 
tions can also be given for other types of frequency-selective filters, such 
as highpass or bandpass. However, the most important design parame- 
ters are frequency-band tolerances (or ripples) and band-edge frequencies. 
Whether the given band is a passband or a stopband is a relatively mi- 
nor issue. Therefore in describing design techniques, we will concentrate 
on a lowpass filter. In the next chapter we will discuss how to transform 
a lowpass filter into other types of frequency-selective filters. Hence it 
makes more sense to develop techniques for a lowpass filter so that we 
can compare these techniques. However, we will also provide examples 
of other types of filters. In light of this discussion our design goal is the 
following. 


Problem statement Design a lowpass filter (i.e., obtain its system 
function H(z) or its difference equation) that has a passband [0, wp] with 
tolerance 6, (or Rp in dB) and a stopband |ws, 7] with tolerance 6 (or 
As in dB). 

In this chapter we turn our attention to the design and approximation 
of FIR digital filters. These filters have several design and implementa- 
tional advantages: 


e The phase response can be exactly linear. 

e They are relatively easy to design since there are no stability problems. 
e They are efficient to implement. 

e The DFT can be used in their implementation. 
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As we discussed in Chapter 6, we are generally interested in linear- 
phase frequency-selective FIR filters. Advantages of a linear-phase re- 
sponse are: 


e design problem contains only real arithmetic and not complex 
arithmetic 

e linear-phase filters provide no delay distortion and only a fixed amount 
of delay 

e for the filter of length M (or order M — 1) the number of operations 
are of the order of M/2 as we discussed in the linear-phase filter im- 
plementation 


We first begin with a discussion of the properties of the linear-phase 
FIR filters, which are required in design algorithms. Then we will discuss 
three design techniques, namely the window design, the frequency sam- 
pling design, and the optimal equiripple design techniques for linear-phase 
FIR filters. 


7.2 PROPERTIES OF LINEAR-PHASE FIR FILTERS 
————————S EEE 


In this section we discuss shapes of impulse and frequency responses and 
locations of system function zeros of linear-phase FIR filters. Let h(n), 
0<n< M-—1 be the impulse response of length (or duration) M. Then 
the system function is 


M-1 


M-1 
H(2)= X nae ae OO X h(n)” 
n=0 A0 


which has (M — 1) poles at the origin z = 0 (trivial poles) and (M — 1) 
zeros located anywhere in the z-plane. The frequency response function 
is 


M-1 
H(e!”) = 5 h(n), —-r<w<r 
n=0 
Now we will discuss specific requirements on the forms of h(n) and H(e/”) 


as well as requirements on the specific locations of (M — 1) zeros that the 
linear-phase constraint imposes. 


7.2.1 IMPULSE RESPONSE h(n) 
We impose a linear-phase constraint 


LH(e”) =-ow, -t<w<a 
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Symmetric Impulse Response: M odd 
T T T 


(M= 1)/2 M-17) 


where a is a constant phase delay. Then we know from Chapter 6 that 
h(n) must be symmetric, that is, 


(7.3) 


h(n) =h(M —-1-—n), (222 ae = 


Hence h(n) is symmetric about a, which is the index of symmetry. There 
are two possible types of symmetry: 


e M odd: In this case a = (M —1)/2 is an integer. The impulse response 
is as shown below. 

e M even: In this case a = (M — 1)/2 is not an integer. The impulse 
response is as shown here. 


Symmetric Impulse Response: M even 


h(n) 


? | i 
Í 7 


oO 
T 


| 1 
M/2+1 M/2 M-1 
n 


We also have a second type of “linear-phase” FIR filter if we require 
that the phase response /H(e!”) satisfy the condition 
LH(e3”) = B — ow 
which is a straight line but not through the origin. In this case a is not a 
constant phase delay, but 
d/H(e?”) 
dw 


= —Q 
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is constant, which is the group delay. Therefore a is called a constant 
group delay. In this case, as a group, frequencies are delayed at a constant 
rate. But some frequencies may get delayed more and others delayed less. 
For this type of linear phase one can show that 


h(n) =—A(M-1-n), 0<n<(M-1); a= ——,f8=+- (7.4) 


This means that the impulse response h(n) is antisymmetric. The index 
of symmetry is still a = (M — 1)/2. Once again we have two possible 
types, one for M odd and one for M even. 


e M odd: In this case a = (M — 1)/2 is an integer and the impulse 
response is as shown. 


Antisymmetric Impulse Response: M odd 
T T T 


h(n) 
oO 
ota 
o 
on 
oo 


0 (M12 M-1 
n 


Note that the sample h(a) at a = (M — 1)/2 must necessarily be equal 
to zero, i.e., h((M — 1)/2) = 0. 

e M even: In this case a = (M — 1)/2 is not an integer and the impulse 
response is as shown. 


Antisymmetric Impulse Response: M even 
T T T 


h(n) 
oO 
Lo 
—o 
Lo 
LO 


L L i L 
0 M/2+1 M/2 M-1 
n 
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7.2.2 FREQUENCY RESPONSE H(e”) 

When the cases of symmetry and antisymmetry are combined with odd 
and even M, we obtain four types of linear-phase FIR filters. Frequency 
response functions for each of these types have some peculiar expressions 
and shapes. To study these responses, we write H(e?”) as 


; ; M-1 
H(e3”) = H, (w) (8-%) = ES a= 


(7.5) 


where H,(w) is an amplitude response function and not a magnitude re- 
sponse function. The amplitude response is a real function, but unlike 
the magnitude response, which is always positive, the amplitude response 
may be both positive and negative. The phase response associated with 
the magnitude response is a discontinuous function, while that associated 
with the amplitude response is a continuous linear function. To illustrate 
the difference between these two types of responses, consider the following 
example. 


EXAMPLE 7.3 Let the impulse response be h(n) = {1,1,1}. Determine and draw frequency 
T 


responses. 


Solution The frequency response function is 


2 
H(t) = Nun” =1+le™ +e% = {e* H1 pe ee 
0 


{1 + 2cosw} e7?” 


From this the magnitude and the phase responses are 


|H(e’”)| = |1+2coswl, O<w<a 
—w, O<w<2n/3 
/H(el) = E 
T—w, 2r/3 <w <T 


since cosw can be both positive and negative. In this case the phase response 
is piecewise linear. On the other hand, the amplitude and the corresponding 
phase responses are 


H, (w) = 1 + 2cosw, 


r -TLWIT 

LH(e?”) = —w, 
In this case the phase response is truly linear. These responses are shown in 
Figure 7.2. From this example, the difference between the magnitude and the 
amplitude (or between the piecewise linear and the linear-phase) responses 
should be clear. 
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Magnitude Response Amplitude Response 


T T 
0 
0 2/3 1 0 2/3 1 
frequency in m units frequency in m units 
Piecewise Linear Phase Response Linear Phase Response 
2 2 
= 2/3 T 
=) 5 
= 0 = 0 
© 2 
D D 
C E 
oO oO 
-2/3 f -2/3 
0 2/3 1 0 2/3 1 
frequency in m units frequency in m units 


FIGURE 7.2 Frequency responses in Example 7.3 


Type-1 linear-phase FIR filter: Symmetrical impulse response, 
M odd In this case 6 = 0, a = (M — 1)/2 is an integer, and h(n) = 
h(M—-—1-—n), 0<n< M-—1. Then we can show (see Problem P7.2) 


that 
(M-1)/2 


H(e?”) = 5 a(n) coswn} e7I®(M-1)/2 (7.6) 


n=0 


where sequence a(n) is obtained from h(n) as 


a(0) =h (==) : the middle sample 
(7.7) 
a(n) = 2h (== -»), l<n< “= 
Comparing (7.5) with (7.6), we have 
(M-—1)/2 
H,(w) = 5 a(n) coswn (7.8) 
n=0 
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Type-2 linear-phase FIR filter: Symmetrical impulse response, 
M even In this case again 8 =0,h(n) =h(M-1-n), 0<n< M-1, 
but a = (M —1)/2 is not an integer. Then we can show (see Problem P7.3) 


that 
M/2 1 
jw) = ae —jw(M-1)/2 
H(t”) > b(n) cos fu (r 5) e (7.9) 
where 
b(n) = 2h (F-») p aba 2: aoe (7.10) 
2 2 
Hence 
M/2 1 
H,(w) = > b(n) cos fu ¢ — 5)} (7.11) 


Note: At w =r we get 


M/2 


H,(x) = > b(n) cos f ¢ = 5) } =0 


regardless of b(n) or h(n). Hence we cannot use this type (i.e., symmetric 
h(n), M even) for highpass or bandstop filters. 


Type-3 linear-phase FIR filter: Antisymmetric impulse response, 
M odd In this case 6 = 7/2, a = (M — 1)/2 is an integer, h(n) = 
—-h(M—-—1-n), 0<n< M-—1, and h((M — 1)/2) = 0. Then we can 
show (see Problem P7.4) that 


(M-1)/2 
H(t”) = 5 c(n) sinwn ell (A )¢] (7.12) 
n=1 
where 
dn) =n (4 =n), ELD, aa (7.13) 
2 2 
and 
(M—1)/2 
H,(w) = 5 c(n) sinwn (7.14) 


n=1 
Note: At w = 0 and w = 7 we have H,(w) = 0, regardless of c(n) or 
h(n). Furthermore, e/*/? = j, which means that j7H,(w) is purely imagi- 
nary. Hence this type of filter is not suitable for designing a lowpass filter 
or a highpass filter. However, this behavior is suitable for approximat- 
ing ideal digital Hilbert transformers and differentiators. An ideal Hilbert 
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transformer [23] is an all-pass filter that imparts a 90° phase shift on the 
input signal. It is frequently used in communication systems for modula- 
tion purposes. Differentiators are used in many analog and digital systems 
to take the derivative of a signal. 


Type-4 linear-phase FIR filter: Antisymmetric impulse response, 
M even This case is similar to Type-2. We have (see Problem P7.5) 


H(i”) = Y dosin fu (n-5)} efla—e@t- 1/2] (7.15) 
"m aa Matai 
and 

Hu) =Y asaf (n— 3) } aan 


Note: At w = 0, H,(0) = 0 and ef7/2? = j. Hence this type is also 
suitable for designing digital Hilbert transformers and differentiators. 


7.2.3 MATLAB IMPLEMENTATION 

The MATLAB function freqz computes the frequency response from 
which we can determine the magnitude response but not the amplitude 
response. The SP toolbox now provides the function zerophase that can 
compute the amplitude response. However, it easy to write simple func- 
tions to compute amplitude responses for each of the four types. We pro- 
vide four functions to do this. 


1. Hr-type1: 


function [Hr,w,a,L] = Hr_Type1(h); 

% Computes Amplitude response Hr(w) of a Type-1 LP FIR filter 
el EE SS EE E E ESOO ee 
% [Hr,w,a,L] = Hr_Type1(h) 

% Hr = Amplitude Response 

% w= 500 frequencies between [0 pi] over which Hr is computed 
% a = Type-1 LP filter coefficients 

% L = Order of Hr 

% h = Type-1 LP filter impulse response 

h 

= length(h); L = (M-1)/2; 

= [h(L+1) 2*h(L:-1:1)]; % 1x(L+1) row vector 

= [0:1:L]; % (L+1)x1 column vector 

= [0:1:500]’*pi/500; Hr = cos(w*n)*a’; 


apo 8 
I 
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2. Hr_type2: 


function [Hr,w,b,L] = Hr_Type2(h); 

% Computes Amplitude response of a Type-2 LP FIR filter 
a ee ee 
% (Hr,w,b,L] = Hr_Type2(h) 

% Hr = Amplitude Response 


% w = frequencies between [0 pi] over which Hr is computed 
% b = Type-2 LP filter coefficients 

% L = Order of Hr 

% h = Type-2 LP impulse response 


h 

M = length(h); L = M/2; 

b = 2*[h(L:-1:1)]; n = [4:1:L]; n = n-0.5; 
w = [0:1:500]’*pi/500; Hr = cos(w*n)*b’; 


3. Hr_type3: 


function [Hr,w,c,L] = Hr_Type3(h) ; 
% Computes Amplitude response Hr(w) of a Type-3 LP FIR filter 
fe da Ne a ate ee ee ee 
% (Hr,w,c,L] = Hr_Type3(h) 
% Hr = Amplitude Response 

w = frequencies between [0 pi] over which Hr is computed 

c = Type-3 LP filter coefficients 
% L = Order of Hr 

h = Type-3 LP impulse response 


M = length(h); L = (M-1)/2; 
= [2*h(L+1:-1:1)]; n = [0:1:L]; 
w = [0:1:500]’*pi/500; Hr = sin(w*n)*c’; 


a 
| 


4. Hr_type4: 


function [Hr,w,d,L] = Hr_Type4(h); 

% Computes Amplitude response of a Type-4 LP FIR filter 
[SEE Ss SOS ss SSE Se eee Se eee 
A (Hr,w,d,L] = Hr_Type4(h) 

% Hr = Amplitude Response 

% w = frequencies between [0 pi] over which Hr is computed 
% d = Type-4 LP filter coefficients 

% L = Order of d 

% h = Type-4 LP impulse response 

h 

M = length(h); L = M/2; 

= 2*[h(L:-1:1)]; n = [1:1:L]; n = n-0.5; 

w = [0:1:500]’*pi/500; Hr = sin(w*n)*d’; 


Q 
I 
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These four functions can be combined into one function, called 
ampl-res, that can be written to determine the type of the linear-phase 
filter and to implement the appropriate amplitude response expression. 
This is explored in Problem P7.6. The use of these functions is described 
in Examples 7.4 through 7.7. 

The zerophase function from the SP toolbox is similar in use to the 
freqz function. The invocation [Hr,w, phi] = zerophase(b,a) returns 
the amplitude response in Hr, evaluated at 512 values around the top half 
of the unit circle in the array w and the continuous phase response in 
phi. Thus, this function can be used for both FIR and IIR filters. Other 
invocations are also available. 


7.2.4 ZERO LOCATIONS 

Recall that for an FIR filter there are (M — 1) (trivial) poles at the origin 
and (M — 1) zeros located somewhere in the z-plane. For linear-phase 
FIR filters, these zeros possess certain symmetries that are due to the 
symmetry constraints on h(n). It can be shown (see [23] and Problem 
P7.7) that if H(z) has a zero at 


z= z = ref? 


then for linear phase there must be a zero at 


For a real-valued filter we also know that if z, is complex, then there must 
be a conjugate zero at z¥ = re~J°, which implies that there must be a 
zero at 1/z* = (1/r) e?®. Thus a general zero constellation is a quadruplet 
, 1 
rel? —e and —e 
as shown in Figure 7.3. Clearly, if r = 1, then 1/r = 1, and hence the 
zeros are on the unit circle and occur in pairs 


jO 


ej —j0 


and e 


If 0 = 0 or 0 = 77, then the zeros are on the real line and occur in pairs 


1 
r and — 
a 
Finally, if r = 1 and 0 = 0 or 0 = 7, the zeros are either at z = 1 or 
z = —1. These symmetries can be used to implement cascade forms with 
linear-phase sections. 
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Pole—Zero Plot 


z—plane 
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FIGURE 7.3 A general zero constellation 


In the following examples, we illustrate the preceding properties of 
linear-phase FIR filters. 


EXAMPLE 7.4 Let h(n) = {—4,1, —1, —2,5,6,5, —2,—1,1,—4}. Determine the amplitude re- 
sponse H, (w) a the locations of the zeros of H (z). 
Solution Since M = 11, which is odd, and since h(n) is symmetric about a = (11—1)/2 = 
5, this is a Type-1 linear-phase FIR filter. From (7.7) we have 
a(0) = h(a) = h(5) = 6, a(1) = 2h(5 — 1) = 10, a(2) = 2h(5 — 2) = —4 
a (3) = 2h (5 — 3) = —2, a(4) = 2h (5 — 4) = 2, a(5) = 2h (5 — 5) = —8 


From (7.8), we obtain 
H, (w) = a(0)+a(1) cosw + a(2) cos 2w + a(3) cos 3w + a(4) cos 4w + a(5) cos 5w 


= 6 + 10cosw — 4 cos 2w — 2 cos 3w + 2 cos 4w — 8 cos 5w 
MATLAB script: 
>> h [ab ih SORO =i il 4] 8 


>> M = length(h); n = 0:M-1; 
>> [Hr,w,a,L] = Hr_Type1(h); 
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>> a,L 
a=6 10 -4 Z2 2 =S 
L=5 


>> amax = max(a)+1; amin = min(a)-1; 

>> subplot(2,2,1); stem(n,h); axis([-1 2*L+1 amin amax]) 
>> xlabel(’n’); ylabel(’h(n)’); title(’Impulse Response’ ) 
>> subplot(2,2,3); stem(0:L,a); axis([-1 2*L+1 amin amax]) 
>> xlabel(’n’); ylabel(’a(n)’); title(’a(n) coefficients’) 
>> subplot (2,2,2); plot(w/pi,Hr) ;grid 

>> xlabel(’frequency in pi units’); ylabel(’Hr’) 

>> title(’Type-1 Amplitude Response’ ) 

>> subplot(2,2,4); pzplotz(h,1) 


The plots and the zero locations are shown in Figure 7.4. From these plots, we 
observe that there are no restrictions on H, (w) either at w = 0 or at w = 7. 
There is one zero-quadruplet constellation and three zero pairs. 


EXAMPLE 7.5 Let h(n) = {—4,1,—1,—2,5,6,6,5,—2,—1,1,—4}. Determine the amplitude 


response H, (w) and the locations of the zeros of H (z). 


Impulse Response Type—1 Amplitude Response 
10 
5 
T 
Z 0 
-5 
-20 
0 5 10 0 0.5 1 
n frequency in r units 
a(n) coefficients Pole—Zero Plot 
10 z-plane 


a(n) 

oO 
Imaginary axis 
| 

K. 


0 5 10 -1 0 1 
n real axis 


FIGURE 7.4 Plots in Example 7.4 
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Solution This is a Type-2 linear-phase FIR filter since M = 12 and since h(n) is sym- 
metric with respect to a = (12 — 1) /2 = 5.5. From (7.10) we have 


b(1) = 2h (2 — 1) = 12, b(2) = 2h(# — 2) = 10, b(3) = 
b(4) = 2h (3 — 4) = —2, b(5) = 2h (2-5) =2, b(6) = 


Hence from (7.11) we obtain 


b(1) cos [w (1-$)] +02 ie (2 -4)] + see [o (3-3)] 
+ b(4) cos [w (4 — 4)] + (5) cos [w (5 = 3)] +6(6) cos [w (6 -= 3)] 
5w 


Baia yes o (2) -2 a) 
p neoa ($2) -sc (12) 


MATLAB script: 


H, (w) 


SS In = A ll e0 Bala salle 

>> M = length(h); n = 0:M-1; [Hr,w,a,L] = Hr_Type2(h); 
>> b,L 

b = 12 10 -4 = 2 -8 

L=6 


>> bmax = max(b)+1; bmin = min(b)-1; 

>> subplot(2,2,1); stem(n,h); axis([-1 2*L+1 bmin bmax]) 
>> xlabel(’n’); ylabel(’h(n)’); title(’Impulse Response’ ) 
>> subplot(2,2,3); stem(1:L,b); axis([-1 2*L+1 bmin bmax]) 
>> xlabel(’n’); ylabel(’b(n)’); title(’b(n) coefficients’) 
>> subplot (2,2,2); plot(w/pi,Hr) ;grid 

>> xlabel(’frequency in pi units’); ylabel(’Hr’) 

>> title(’Type-1 Amplitude Response’ ) 

>> subplot(2,2,4); pzplotz(h,1) 


The plots and the zero locations are shown in Figure 7.5. From these plots, we 
observe that H, (w) is zero at w = 7. There is one zero-quadruplet constellation, 
three zero pairs, and one zero at w = 7 as expected. 


EXAMPLE 7.6 Let h(n) = {—4,1,—1,—2,5,0,—5,2,1,—1,4}. Determine the amplitude re- 
T 


sponse H, (w) and the locations of the zeros of H (z). 


Solution Since M = 11, which is odd, and since h(n) is antisymmetric about a = 
(11 — 1)/2 = 5, this is a Type-3 linear-phase FIR filter. From (7.13) we have 


c(0) = h(a) = A(5) = 0, c(1) = 2h(5 — 1) = 10, c(2) = 2h(2 — 2) = —4 
c(3) = 2h (5 — 3) = —2, c(4) = 2h (5 — 4) =2, c(5) = 2h (5 — 5) = —8 
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Impulse Response Type—2 Amplitude Response 
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FIGURE 7.5 Plots in Example 7.5 


From (7.14) we obtain 


H, (w) = c(0) + c(1) sinw + c(2) sin 2w + c(3) sin 3w + c(4) sin 4w + c(5) sin 5w 


= 0 + 10sinw — 4sin 2w — 2 sin 3w + 2sin 4w — 8 sin 5w 


MATLAB script: 


SS In = [= = 2,505,251 ,=1 412 

>> M = length(h); n = 0:M-1; [Hr,w,c,L] = Hr_Type3(h) ; 
>> c,L 

a=0 10 -4 =2 2 -8 

L=5 


>> cmax = max(c)+1; cmin = min(c)-1; 

>> subplot(2,2,1); stem(n,h); axis([-1 2*L+1 cmin cmax]) 
>> xlabel(’n’); ylabel(’h(n)’); title(’Impulse Response’ ) 
>> subplot(2,2,3); stem(O:L,c); axis([-1 2*L+1 cmin cmax]) 
>> xlabel(’n’); ylabel(’c(n)’); title(’c(n) coefficients’) 
>> subplot (2,2,2); plot(w/pi,Hr) ;grid 

>> xlabel(’frequency in pi units’); ylabel(’Hr’) 

>> title(’Type-1 Amplitude Response’ ) 

>> subplot(2,2,4); pzplotz(h,1) 
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The plots and the zero locations are shown in Figure 7.6. From these plots, we 
observe that H, (w) = 0 at w = 0 and at w = m. There is one zero-quadruplet 
constellation, two zero pairs, and zeros at w = 0 and w = 7 as expected. 


Impulse Response Type—3 Amplitude Response 
30 
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5 
T 
Z 0 
-5 
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10 z-plane 
; lo 
(J 
= Pal 
5 0 a way, 
D 
3 b 
-5 =i i 
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FIGURE 7.6 Plots in Example 7.6 


EXAMPLE 7.7 Let h(n) = {—4,1, —1,—2,5,6,—6, —5,2,1,—1,4}. Determine the amplitude 


T 
response H, (w) and the locations of the zeros of H (z). 


Solution This is a Type-4 linear-phase FIR filter since M = 12 and since h(n) is anti- 
symmetric with respect to a = (12 — 1) /2 = 5.5. From (7.16) we have 


d(1) = 2h (# — 1) = 12, d(2) = 2h (#2 — 2) = 10, d(3) = 2h (2 — 3) = —4 

d(4) = 2h (# — 4) = —2, d(5) = 2h (2 —- 5) =2, d(6) = 2h (2 — 6) = -8 
Hence from (7.17) we obtain 
H, (w) = d(1)sin E (2 — 5)] + d(2) sin E (2 — 5) + d(3) sin [v (3 — 5)] 

+d(4) sin [o (4 — 5)] + d(5) sin E (5 — 5)] + d(6) sin [v (6 — )] 
(5) + 10sin (=) Asin (=) 2sin (=) 
: w . (1lw 

-2sin (=) 8sin ( 5 ) 


II 
= 
© 
Zz 
=] 
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FIGURE 7.7 Plots in Example 7.7 


MATLAB script: 


2D = Alon One Ol Oba E1 A; 
>> M = length(h); n = 0:M-1; [Hr,w,d,L] = Hr_Type4(h); 


>> b,L 
d= 12 10 -4 =2 2 -8 
L=6 


>> dmax = max(d)+1; dmin = min(d)-1; 

>> subplot(2,2,1); stem(n,h); axis([-1 2*L+1 dmin dmax]) 
>> xlabel(’n’); ylabel(’h(n)’); title(’Impulse Response’ ) 
>> subplot(2,2,3); stem(1:L,d); axis([-1 2*L+1 dmin dmax]) 
>> xlabel(’n’); ylabel(’d(n)’); title(’d(n) coefficients’) 
>> subplot (2,2,2); plot(w/pi,Hr) ;grid 

>> xlabel(’frequency in pi units’); ylabel(’Hr’) 

>> title(’Type-1 Amplitude Response’ ) 

>> subplot(2,2,4); pzplotz(h,1) 


The plots and the zero locations are shown in Figure 7.7. From these plots, we 
observe that H, (w) is zero at w = 0. There is one zero-quadruplet constellation, 
three zero pairs, and one zero at w = 0 as expected. 
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7.3 WINDOW DESIGN TECHNIQUES 
—— gp 


The basic idea behind the window design is to choose a proper ideal 
frequency-selective filter (which always has a noncausal, infinite-duration 
impulse response) and then to truncate (or window) its impulse response 
to obtain a linear-phase and causal FIR filter. Therefore the emphasis 
in this method is on selecting an appropriate windowing function and 
an appropriate ideal filter. We will denote an ideal frequency-selective 
filter by Hale”), which has a unity magnitude gain and linear-phase 
characteristics over its passband, and zero response over its stopband. An 
ideal LPF of bandwidth we < 7 is given by 


Ls ese lw] < we 


Hale”) = l (7.18) 


0, we < w| <r 


where we is also called the cutoff frequency, and a is called the sample 
delay. (Note that from the DTFT properties, e71% implies shift in the 
positive n direction or delay.) The impulse response of this filter is of 
infinite duration and is given by 


haln) = Hye) | = z | aao (7.19) 


te TaS 
= 1-e 90% edw 
_ sin [we(n — a)] 


m(n — a) 


Note that hg(n) is symmetric with respect to a, a fact useful for linear- 
phase FIR filters. 

To obtain an FIR filter from ha(n), one has to truncate ha(n) on both 
sides. To obtain a causal and linear-phase FIR filter h(n) of length M, we 
must have 


(7.20) 


0, elsewhere ae oe 2 


ha(n), O<n<M-1 M-1 
h(n) = 


This operation is called “windowing.” In general, h(n) can be thought of 
as being formed by the product of ha(n) and a window function w(n) as 
follows: 

h(n) = ha(n)w(n) (7.21) 
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where 
some symmetric function with respect to 


w(n) = aover0<n<M-1 
0, otherwise 


Depending on how we define w(n), we obtain different window designs. 
For example, in (7.20) 


10<n<M-1 


w(n) = i 
0, otherwise 


= Ro (n) 


which is the rectangular window defined earlier. 
In the frequency domain the causal FIR filter response H (e7”) is given 
by the periodic convolution of Ha(e’”) and the window response W (e?®); 


that is, 
H(t”) = Ha(e?”) ©) W (ef) = - T W (e>) Ha G dà 


This is shown pictorially in Figure 7.8 for a typical window response, from 
which we have the following observations: 


1. Since the window w(n) has a finite length equal to M, its response has 
a peaky main lobe whose width is proportional to 1/M, and has side 
lobes of smaller heights. 


Hel) 


jo 
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FIGURE 7.8 Windowing operation in the frequency domain 
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2. The periodic convolution (7.22) produces a smeared version of the ideal 
response Ha(e)”). 

3. The main lobe produces a transition band in H(e?”) whose width is 
responsible for the transition width. This width is then proportional to 
1/M. The wider the main lobe, the wider will be the transition width. 

4. The side lobes produce ripples that have similar shapes in both the 
passband and stopband. 


Basic window design idea For the given filter specifications, choose 
the filter length M and a window function w(n) for the narrowest main 
lobe width and the smallest side lobe attenuation possible. 

From observation 4, we note that the passband tolerance 6; and the 
stopband tolerance 62 cannot be specified independently. We generally 
take care of 62 alone, which results in 62 = 1. We now briefly describe 
various well-known window functions. We will use the rectangular window 
as an example to study their performances in the frequency domain. 


7.3.1 RECTANGULAR WINDOW 
This is the simplest window function but provides the worst performance 
from the viewpoint of stopband attenuation. It was defined earlier by 


1,0<n<M-1 
w= f (7.23) 


0, otherwise 


Its frequency response function is 


which is the amplitude response. From (7.22) the actual amplitude re- 
sponse H, (w) is given by 


| waa [ Zao. M>1 (7.24) 


=i = 


This implies that the running integral of the window amplitude response 
(or accumulated amplitude response) is necessary in the accurate analysis 
of the transition bandwidth and the stopband attenuation. Figure 7.9 
shows the rectangular window function w(n), its amplitude response 
W (w), the amplitude response in dB, and the accumulated amplitude 
response (7.24) in dB. From the observation of plots in Figure 7.9, we can 
make several observations. 
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FIGURE 7.9 Rectangular window: M = 45 


1. The amplitude response W, (w) has the first zero at w = w1, where 


wı M 2T 
= or wi = — 


2 M 
Hence the width of the main lobe is 2w = 4r /M. Therefore the ap- 
proximate transition bandwidth is 4r /M. 


2. The magnitude of the first side lobe (which is also the peak side lobe 
magnitude) is approximately at w = 37m/M and is given by 


o (37 
m (e= | ma) ae ey 
sin (37) 37 


Comparing this with the main lobe amplitude, which is equal to M, 
the peak side lobe magnitude is 


= = 21.22% = 13 dB 


T 
of the main lobe amplitude. 


3. The accumulated amplitude response has the first side lobe magnitude 
at 21 dB. This results in the minimum stopband attenuation of 21 dB 
irrespective of the window length M. 
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4. Using the minimum stopband attenuation, the transition bandwidth 
can be accurately computed. It is shown in the accumulated amplitude 
response plot in Figure 7.9. This computed exact transition bandwidth is 


1.87 
ie may 


which is less than half the approximate bandwidth of 47/M. 


Clearly, this is a simple window operation in the time domain and 
an easy function to analyze in the frequency domain. However, there are 
two main problems. First, the minimum stopband attenuation of 21 dB is 
insufficient in practical applications. Second, the rectangular windowing 
being a direct truncation of the infinite length hg (n), it suffers from the 
Gibbs phenomenon. If we increase M, the width of each side lobe will 
decrease, but the area under each lobe will remain constant. Therefore, the 
relative amplitudes of side lobes will remain constant, and the minimum 
stopband attenuation will remain at 21 dB. This implies that all ripples 
will bunch up near the band edges. It is shown in Figure 7.10. 

Since the rectangular window is impractical in many applications, 
we consider other fixed window functions that provide a fixed amount 


= 
= 
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FIGURE 7.10 Gibbs phenomenon 
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of attenuation. These window functions bear the names of the people 
who first proposed them. Although these window functions can also be 
analyzed similar to the rectangular window, we present only their results. 


7.3.2 BARTLETT WINDOW 

Since the Gibbs phenomenon results from the fact that the rectangular 
window has a sudden transition from 0 to 1 (or 1 to 0), Bartlett suggested 
a more gradual transition in the form of a triangular window, which is 


given by 
2n ee <M-i 
M-I’ SSD 
w(n) = 9 2n Eee og AG (7.25) 
M-1 2 
0, otherwise 


This window and its frequency-domain responses are shown in Figure 7.11. 
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FIGURE 7.11 Bartlett window: M = 45 
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Hann Window : M=45 Amplitude Response in dB 
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FIGURE 7.12 Hann window: M = 45 


7.3.3 HANN WINDOW 
This is a raised cosine window function given by 


ae 0.5 fi- cos (#24), 0<n<M-1 os 


0, otherwise 


This window and its frequency-domain responses are shown in Figure 7.12. 


7.3.4 HAMMING WINDOW 
This window is similar to the Hann window except that it has a small 


amount of discontinuity and is given by 


0.54 — 0.46 cos (28%), 0<n<M-1 re 


w(n) = 
0, otherwise 


This window and its frequency-domain responses are shown in Figure 7.13. 
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Hamming Window : M=45 Amplitude Response in dB 
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FIGURE 7.13 Hamming window: M = 45 


7.3.5 BLACKMAN WINDOW 
This window is also similar to the previous two but contains a second 
harmonic term and is given by 


Tn Ann 
0.42 — 0.5 cos (22%) + 0.08 cos (47%), 0<n<M-=1 


w(n) = 
0, otherwise 


(7.28) 


This window and its frequency-domain responses are shown in Figure 7.14. 
In Table 7.1 we provide a summary of fixed window function charac- 
teristics in terms of their transition widths (as a function of M) and their 
minimum stopband attenuations in dB. Both the approximate as well as 
the exact transition bandwidths are given. Note that the transition widths 
and the stopband attenuations increase as we go down the table. The 
Hamming window appears to be the best choice for many applications. 


7.3.6 KAISER WINDOW 
This is an adjustable window function that is widely used in practice. The 
window function is due to J. F. Kaiser and is given by 


sel Sea O<n<M-1 (7.29) 


Io [8] 
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Blackman Window : M=45 Amplitude Response in dB 
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FIGURE 7.14 Blackman window: M = 45 
TABLE 7.1 Summary of commonly used window function characteristics 
Window Transition Width Aw Min. Stopband 
Name Approximate Exact Values Attenuation 
AT 1.87 
Rectangular — — 21 dB 
E M M 
8T 6.17 
Bartlett — — 25 dB 
r M M 5 
8T 6.27 
Hann — —— 44 dB 
M M 
81 6.67 
Hammin, — — 53 dB 
ae M M 
127 lla 
Blackman — — 74 dB 
M M 
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where Io[-] is the modified zero-order Bessel function given by 


which is positive for all real values of x. The parameter 8 controls the 
minimum stopband attenuation A, and can be chosen to yield different 
transition widths for near-optimum A,. This window can provide different 
transition widths for the same M, which is something other fixed windows 
lack. For example, 


e if 8 = 5.658, then the transition width is equal to 7.87/M, and the 
minimum stopband attenuation is equal to 60 dB. This is shown in 
Figure 7.15. 

e if 8 = 4.538, then the transition width is equal to 5.87/M, and the 
minimum stopband attenuation is equal to 50 dB. 


Hence the performance of this window is comparable to that of the 
Hamming window. In addition, the Kaiser window provides flexible tran- 
sition bandwidths. Due to the complexity involved in the Bessel functions, 
the design equations for this window are not easy to derive. Fortunately, 
Kaiser has developed empirical design equations, which we provide here 
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FIGURE 7.15 Kaiser window: M = 45, B = 5.658 
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without proof. Given wp, ws, Rp, and A, the parameters M and ( are 


Ds 
given by 


transition width = Aw = ws — Wp 
A, — 7.95 


Filter length M o eS 
re 2.285 Aw 


+1 (7.30) 


0.1102(4, — 8.7), As > 50 


Parameter @ = 0.5842 (A, — 21)°4 
+ 0.07886(A, — 21), 21 < A, < 50 


7.3.7 MATLAB IMPLEMENTATION 
MATLAB provides several functions to implement window functions dis- 
cussed in this section. A brief description of these functions follow. 


e w=boxcar(M) returns the M-point rectangular window function in ar- 
ray w. 

e w=bartlett(M) returns the Mpoint Bartlett window function in ar- 
ray w. 
w=hann(M) returns the M-point Hann window function in array w. 
w=hamming(M) returns the M-point Hamming window function in ar- 
ray w. 

e w=blackman(M) returns the M-point Blackman window function in ar- 
ray w. 

e w=kaiser(M,beta) returns the beta-valued M-point rectangular win- 
dow function in array w. 


Using these functions, we can use MATLAB to design FIR filters based 
on the window technique, which also requires an ideal lowpass impulse 
response hq(n). Therefore it is convenient to have a simple routine that 
creates hg(n) as shown here. 


function hd = ideal_lp(wc,M); 

% Ideal LowPass filter computation 

A re RE A Ee Dente een ero 

% [hd] = ideal_lp(wce,M) 

% hd = ideal impulse response between 0 to M-1 
% we = cutoff frequency in radians 

% M= length of the ideal filter 


alpha = (M-1)/2; n = [0:1:(M-1)]; 
m =n - alpha; fc = wc/pi; hd = fc*sinc(fc*m) ; 
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To display the frequency-domain plots of digital filters, MATLAB 
provides the freqz function, which we used in earlier chapters. Using this 
function, we have developed a modified version, called freqz_m, which 
returns the magnitude response in absolute as well as in relative dB scale, 
the phase response, and the group delay response. We will need the group 
delay response in the next chapter. 


function [db,mag,pha,grd,w] = freqz_m(b,a); 

% Modified version of freqz subroutine 

Fp et a 

% (db,mag,pha,grd,w] = freqz_m(b,a); 

% db = Relative magnitude in dB computed over 0 to pi radians 
% mag = absolute magnitude computed over 0 to pi radians 
% pha = Phase response in radians over 0 to pi radians 

% grd = Group delay over 0 to pi radians 

% w= 501 frequency samples between 0 to pi radians 

% b = numerator polynomial of H(z) (for FIR: b=h) 

% a = denominator polynomial of H(z) (for FIR: a=[1]) 


[H,w] = freqz(b,a,1000, ’whole’); 
H = (H(1:1:501))?; w = (w(1:1:501))’; 
mag = abs(H); db = 20*10g10((magteps) /max (mag) ) ; 
pha = angle(H); grd = grpdelay(b,a,w) ; 


7.3.8 DESIGN EXAMPLES 
We now provide several examples of FIR filter design using window tech- 
niques and MATLAB functions. 


EXAMPLE 7.8 Design a digital FIR lowpass filter with the following specifications: 


Wp = 0.27, Rp = 0.25 dB 
ws =0.30, A, = 50 dB 


Choose an appropriate window function from Table 7.1. Determine the impulse 
response and provide a plot of the frequency response of the designed filter. 


Solution Both the Hamming and Blackman windows can provide attenuation of more 
than 50 dB. Let us choose the Hamming window, which provides the smaller 
transition band and hence has the smaller order. Although we do not use the 
passband ripple value of Rp = 0.25 dB in the design, we will have to check 
the actual ripple from the design and verify that it is indeed within the given 
tolerance. The design steps are given in the following MATLAB script. 
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>> wp = 0.2*pi; ws = 0.3*pi; tr_width = ws - wp; 

>> M = ceil(6.6*pi/tr_width) + 1 

M = 67 

>> n=[0:1:M-1]; 

>> wc = (wstwp)/2, % Ideal LPF cutoff frequency 

>> hd = ideal_lp(wc,M); w_ham = (hamming(M))’; h = hd .* w_ham; 
>> [db,mag,pha,grd,w] = freqz_m(h,[1]); delta_w = 2*pi/1000; 


>> Rp = -(min(db(1:1:wp/delta_w+1))); % Actual Passband Ripple 

Rp = 0.0394 

>> As = -round(max(db(ws/delta_wt1:1:501))) % Min Stopband attenuation 
As = 52 

% plots 


>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot (2,2,2); stem(n,w_ham) ;title(’Hamming Window’) 

>> axis([0 M-1 O 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’ ) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot(2,2,4); plot(w/pi,db) ;title(’Magnitude Response in dB’);grid 

>> axis([0 1 -100 10]); xlabel(’frequency in pi units’); ylabel(’Decibels’ ) 


Note that the filter length is M = 67, the actual stopband attenuation is 
52 dB, and the actual passband ripple is 0.0394 dB. Clearly, the passband 
ripple is satisfied by this design. This practice of verifying the passband ripple 
is strongly recommended. The time- and the frequency-domain plots are shown 
in Figure 7.16. 


EXAMPLE 7.9 For the design specifications given in Example 7.8, choose the Kaiser window 
to design the necessary lowpass filter. 


Solution The design steps are given in the following MATLAB script. 


>> wp = 0.2*pi; ws = 0.3*pi; As = 50; tr_width = ws - wp; 

>> M = ceil((As-7.95)/(2.285*tr_width/)+1) + 1 

M = 61 

>> n=[0:1:M-1]; beta = 0.1102*(As-8.7) 

beta = 4.5513 

>> wc = (wstwp)/2; hd = ideal_lp(wc,M); 

>> w_kai = (kaiser(M,beta))’; h = hd .* w_kai; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); delta_w = 2*pi/1000; 

>> As = -round(max(db(ws/delta_wt1:1:501))) % Min Stopband Attenuation 
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FIGURE 7.16 Lowpass filter plots for Example 7.8 


As = 52 

% Plots 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_kai) ;title(’Kaiser Window’) 

>> axis([0 M-1 0 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’ ) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4) ;plot(w/pi,db) ;title(’Magnitude Response in dB’);grid 

>> axis([0 1 -100 10]); xlabel(’frequency in pi units’); ylabel(’Decibels’ ) 


Note that the Kaiser window parameters are M = 61 and @ = 4.5513 and that 
the actual stopband attenuation is 52 dB. The time- and the frequency-domain 
plots are shown in Figure 7.17. 
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FIGURE 7.17 Lowpass filter plots for Example 7.9 


EXAMPLE 7.10 Let us design the following digital bandpass filter. 


lower stopband edge: wis = 0.27, A, = 60 dB 
lower passband edge: wip = 0.357, Rp = 1 dB 
upper passband edge: w2p = 0.657 Rp = 1dB 
upper stopband edge: we, = 0.8% As = 60 dB 


These quantities are shown in Figure 7.18. 


0 0.35 0.35 0.65 0.8 1 


oO 


Decibels 


FIGURE 7.18 Bandpass filter specifications in Example 7.10 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Window Design Techniques 337 


Solution There are two transition bands, namely, Aw, = Wip — Wis and Aws = W25 — Wap. 
These two bandwidths must be the same in the window design; that is, there is 
no independent control over Aw; and Aw2. Hence Aw; = Aw2 = Aw. For this 
design we can use either the Kaiser window or the Blackman window. Let us 
use the Blackman Window. We will also need the ideal bandpass filter impulse 
response ha (n). Note that this impulse response can be obtained from two ideal 
lowpass magnitude responses, provided they have the same phase response. This 
is shown in Figure 7.19. Therefore the MATLAB routine ideal_lp(wc,M) is 
sufficient to determine the impulse response of an ideal bandpass filter. The 
design steps are given in the following MATLAB script. 


>> ws1 = 0.2*pi; wp1 = 0.35*pi; wp2 = 0.65*pi; ws2 = 0.8*pi; As = 60; 
>> tr_width = min((wpi-ws1),(ws2-wp2)); M = ceil(11*pi/tr_width) + 1 
M = 75 

>> n=[0:1:M-1]; wel = (wsitwp1)/2; wc2 = (wp2+ws2)/2; 

>> hd = ideal_lp(wc2,M) - ideal_lp(wc1,M); 

>> w_bla = (blackman(M))’; h = hd .* w_bla; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); delta_w = 2*pi/1000; 

>> Rp = -min(db(wpi/delta_wt1:1:wp2/delta_w)) % Actua; Passband Ripple 


Rp = 0.0030 

>> As = -round(max(db(ws2/delta_w+1:1:501))) % Min Stopband Attenuation 
As = 75 

%Plots 


>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 
>> axis([0 M-1 -0.4 0.5]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_bla) ;title(’Blackman Window’) 

>> axis([O M-1 0 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’) 
>> axis([0 M-1 -0.4 0.5]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4) ;plot(w/pi,db);axis([0 1 -150 10]); 

>> title(’Magnitude Response in dB’) ;grid; 

>> xlabel(’frequency in pi units’); ylabel(’Decibels’) 


Oo 


@c2 m 


0 Oct m 


FIGURE 7.19 Ideal bandpass filter from two lowpass filters 
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FIGURE 7.20 Bandpass filter plots in Example 7.10 


Note that the Blackman window length is M = 61 and that the actual stopband 
attenuation is 75 dB. The time- and the frequency-domain plots are shown in 


Figure 7.20. 


EXAMPLE 7.11 The frequency response of an ideal bandstop filter is given by 


1, O0<|wl<7/3 
H.(e?”) =< 0, 2/3 <|w| < 20/3 
1, 27/3 < |w| <a 


Using a Kaiser window, design a bandstop filter of length 45 with stopband 
attenuation of 60 dB. 


Solution Note that in these design specifications, the transition bandwidth is not given. 
It will be determined by the length M = 45 and the parameter ( of the 
Kaiser window. From the design equations (7.30), we can determine 8 from As; 
that is, 


B = 0.1102 x (As — 8.7) 
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The ideal bandstop impulse response can also be determined from the ideal 
lowpass impulse response using a method similar to Figure 7.19. We can now 
implement the Kaiser window design and check for the minimum stopband 
attenuation. This is shown in the following MATLAB script. 


>> M = 45; As = 60; n=[0:1:M-1]; 

>> beta = 0.1102*(As-8.7) 

beta = 5.6533 

>> w_kai = (kaiser(M,beta))’; wel = pi/3; wc2 = 2*pi/3; 

>> hd = ideal_lp(wc1,M) + ideal_lp(pi,M) - ideal_lp(wc2,M) ; 
>> h = hd .* w_kai; [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_kai);title(’Kaiser Window’) 

>> axis([-1 M 0 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4);plot(w/pi,db); axis([0 1 -80 10]); 

>> title(’Magnitude Response in dB’) ;grid; 

>> xlabel(’frequency in pi units’); ylabel(’Decibels’) 


The @ parameter is equal to 5.6533, and, from the magnitude plot in Figure 7.21, 
we observe that the minimum stopband attenuation is smaller than 60 dB. 
Clearly, we have to increase @ to increase the attenuation to 60 dB. The required 
value was found to be 8 = 5.9533. 
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FIGURE 7.21 Bandstop filter magnitude response in Example 7.11 for 8 = 
5.6533 
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FIGURE 7.22 Bandstop filter plots in Example 7.11: B = 5.9533 


>> M = 45; As = 60; n=[0:1:M-1]; 

>> beta = 0.1102*(As-8.7)+0.3 

beta = 5.9533 

>> w_kai = (kaiser(M,beta))’; wel = pi/3; wc2 = 2*pi/3; 

>> hd = ideal_lp(wc1,M) + ideal_lp(pi,M) - ideal_lp(wc2,M); 
>> h = hd .* w_kai; ([db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_kai);title(’Kaiser Window’) 

>> axis([-1 M 0 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot (2,2,3); stem(n,h);title(’Actual Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4);plot(w/pi,db); axis([0 1 -80 10]); 

>> title(’Magnitude Response in dB’) ;grid; 

>> xlabel(’frequency in pi units’); ylabel(’Decibels’) 


The time- and the frequency-domain plots are shown in Figure 7.22, in which 
the designed filter satisfies the necessary requirements. 
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EXAMPLE 7.12 The frequency response of an ideal digital differentiator is given by 


jw,0<w<T7 


Ha(e?”) = { (7.31) 


—jw, -T<w<0 


Using a Hamming window of length 21, design a digital FIR differentiator. Plot 
the time- and the frequency-domain responses. 


Solution The ideal impulse response of a digital differentiator with linear phase is given 
by 


ha(n) = F [Halte] _ + [ aE eieaa 


0 T 
+ J (—jw) e Ie ei" dw ae + / (jw) eT eier dy 
-T 0 


Il 

= 
| 

= 


0, n=a 


This impulse response can be implemented in MATLAB, along with the 
Hamming window to design the required differentiator. Note that if M is an 
even number, then a = (M — 1)/2 is not an integer and ha (n) will be zero for 
all n. Hence M must be an odd number, and this will be a Type-3 linear- 
phase FIR filter. However, the filter will not be a full-band differentiator since 
H, (T) = 0 for Type-3 filters. 


>> M = 21; alpha = (M-1)/2; n = 0:M-1; 

>> hd = (cos(pi*(n-alpha)))./(n-alpha); hd(alpha+1)=0; 

>> w_ham = (hamming(M))’; h = hd .* w_ham; ([Hr,w,P,L] = Hr_Type3(h); 
% plots 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 

>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_ham) ;title(’Hamming Window’) 

>> axis([-1 M 0 1.2]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’) 

>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4);plot(w/pi,Hr/pi); title(’Amplitude Response’) ; grid; 
>> xlabel(’frequency in pi units’); ylabel(’slope in pi units’); axis([0 1 0 1]); 


The plots are shown in Figure 7.23. 
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FIGURE 7.23 FIR differentiator design in Example 7.12 


EXAMPLE 7.13 Design a length-25 digital Hilbert transformer using a Hann window. 


Solution The ideal frequency response of a linear-phase Hilbert transformer is given by 


jin) = aa O<w<rT 


Hale é . 
+je I, -r <w<0 


(7.32) 


After inverse transformation the ideal impulse response is given by 


2 sin? 7 (n — a) /2 


ha (n) = T n— a 


, 
0, n=a 


which can be easily implemented in MATLAB. Note that since M = 25, the 
designed filter is of Type-3. 


MATLAB script: 


>> M = 25; alpha = (M-1)/2; n = 0:M-1; 

>> hd = (2/pi)*((sin((pi/2)*(n-alpha)).*2)./(n-alpha)); hd(alphat1)=0; 
>> whan = (hann(M))’; h = hd .* w_han; ([Hr,w,P,L] = Hr_Type3(h); 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response’ ) 

>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’hd(n) ’) 
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FIGURE 7.24 FIR Hilbert transformer design in Example 7.13 


>> subplot(2,2,2); stem(n,w_han);title(’Hann Window’) 

>> axis([-1 M 0 1.2]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot (2,2,3); stem(n,h);title(’Actual Impulse Response’) 

>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’h(n)’) 

>> w= w’; Hr = Hr’; 

>> W [-fliplr (w), w(2:501)]; Hr = [-fliplr(Hr), Hr(2:501)]; 

>> subplot (2,2,4);plot(w/pi,Hr); title(’Amplitude Response’) ;grid; 

>> xlabel(’frequency in pi units’); ylabel(’Hr’); axis([-1 1 -1.1 1.1]); 


The plots are shown in Figure 7.24. Observe that the amplitude response is 
plotted over -rn <w < T. 


The SP toolbox provides a function called fir1 which designs conven- 
tional lowpass, highpass, and other multiband FIR filters using window 
technique. This function’s syntax has several forms, including: 


e h = fir1(N,wc) designs an Nth-order (N = M — 1) lowpass FIR 
filter and returns the impulse response in vector h. By default this is 
a Hamming-window based, linear-phase design with normalized cutoff 
frequency in wc which is a number between 0 and 1, where 1 corresponds 
to m rad/sample. If wc is a two-element vector, i.e., wc = [wel wc2], 
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then fir1 returns a bandpass filter with passband cutoffs wc1 and we2. 
If wc is a multi-element (more than two) vector, then fir1 returns a 
multiband filter with cutoffs given in we. 


e h = firi(N,wc,’ftype’) specifies a filter type, where ’ftype’ is: 


a. ?high’ for a highpass filter with cutoff frequency Wn. 

b. ?stop’ for a bandstop filter, if Wc = [wc1 wc2]. The stopband fre- 
quency range is specified by this interval. 

c. ?DC-1’ to make the first band of a multiband filter a passband. 

d. ?DC-0’ to make the first band of a multiband filter a stopband. 


e h = firi(N,wc,’ftype’,window) or h = firl(N,wc,window) uses 
the vector window of length N+1 obtained from one of the specified 
MATLAB window function. The default window function used is the 
Hamming window. 


To design FIR filters using the Kaiser window, the SP toolbox pro- 
vides the function kaiserord, which estimates window parameters that 
can be used in the fir1 function. The basic syntax is 


[N,wc,beta,ftype] = kaiserord(f,m,ripple) ; 


The function computes the window order N, the cutoff frequency vector 
wc, parameter 0 in beta, and the filter type ftype as discussed. The 
vector f is a vector of normalized band edges and m is a vector specifying 
the desired amplitude on the bands defined by f. The length of f is twice 
the length of m, minus 2; i.e., f does not contain 0 or 1. The vector ripple 
specifies tolerances in each band (not in decibels). Using the estimated 
parameters, Kaiser window array can be computed and used in the fir1 
function. 

To design FIR filters using window technique with arbitrary shaped 
magnitude response, the SP toolbox provides the function fir2, which 
also incorporates the frequency sampling technique. It is explained in the 
following section. 


7.4 FREQUENCY SAMPLING DESIGN TECHNIQUES 
2 Ee ae 


In this design approach we use the fact that the system function H (z) 
can be obtained from the samples H (k) of the frequency response H (e?”). 
Furthermore, this design technique fits nicely with the frequency sampling 
structure that we discussed in Chapter 6. Let h(n) be the impulse response 
of an M-point FIR filter, H(k) be its M-point DFT, and H(z) be its 
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system function. Then from (6.12) we have 


M-1 M-1 
n l-z™™ H(k) 
H(z) = 2 h(n)z"” = if 2 o e (7.33) 
and TEs 
; Lee E H(k) 
jw) — 
H(&”) = Vi [ee ajtak/M (7.34) 
k=0 
with 
H (0), k=0 
H (k) = H (eM) = BO) 
H* (M-k), k=1,...,M -1 
For a linear-phase FIR filter we have 
h(n) = +h(M —1-n), n=0,1,...,M-1 


where the positive sign is for the Type-1 and Type-2 linear-phase filters, 
while the negative sign is for the Type-3 and Type-4 linear-phase filters. 
Then H (k) is given by 


H (k) = H, (FF) ci LHW) (7.35) 
where 
H (FF) Sy ies i (7.36) 
"\ H, (24-8) k=1,...,M—1 
and 


e Gr). bo AP] 


LH (k) , (Type-1 & 2) 
+(4) Fu k), k= [#2 il a 
(22) (+) (FE). #0. |] 
JG) = - (£5) (F) Fo S Types & 4) 
b= |) anne (7.38) 
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Finally, we have 
h(n) = IDFT [H (k)] (7.39) 


Note that several textbooks (e.g., [18, 23, 24]) provide explicit formu- 
las to compute h(n), given H(k). We will use MATLAB’s ifft function 
to compute h(n) from (7.39). 


Basic idea Given the ideal lowpass filter Ha(e’”), choose the filter 
length M and then sample Hy(e%”) at M equispaced frequencies between 
0 and 27. The actual response H(e)”) is the interpolation of the samples 
H(k) given by (7.34). This is shown in Figure 7.25. The impulse response 
is given by (7.39). Similar steps apply to other frequency-selective filters. 
Furthermore, this idea can also be extended for approximating arbitrary 
frequency-domain specifications. 
From Figure 7.25, we observe the following: 


1. The approximation error—that is, the difference between the ideal and 
the actual response—is zero at the sampled frequencies. 


2. The approximation error at all other frequencies depends on the shape 
of the ideal response; that is, the sharper the ideal response, the larger 
the approximation error. 


3. The error is larger near the band edges and smaller within the band. 


There are two design approaches. In the first approach, we use the 
basic idea literally and provide no constraints on the approximation er- 
ror; that is, we accept whatever error we get from the design. This ap- 
proach is called a naive design method. In the second approach, we try to 
minimize error in the stopband by varying values of the transition band 
samples. It results in a much better design called an optimum design 
method. 


Ideal Response and 
Frequency Samples 


Frequency Samples and 
Approximated Response 


L | | | 
5 6 7 8 9 10 


oO 


st- 


| 

| 

| 

| 

| 

i 

| 

|| l 
0123456789107 01234 


FIGURE 7.25 Pictorial description of frequency sampling technique 
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7.4.1 NAIVE DESIGN METHOD 
In this method we set H(k) = Ha(e}?7*/™), k=0,...,M—1 and use 
(7.35) through (7.39) to obtain the impulse response h(n). 


EXAMPLE 7.14 Consider the lowpass filter specifications from Example 7.8. 


Wp = 0.20, Rp = 0.25 dB 
ws = 0.37, As = 50 dB 


Design an FIR filter using the frequency sampling approach. 


Solution Let us choose M = 20 so that we have a frequency sample at wp, that is, at 
k= 2: 
2m 
= 0.2r = —2 
Pp T= 20 


and the next sample at ws, that is, at k = 3: 


2T 
Ws = 0.37 = 20° 


Thus we have 3 samples in the passband [0 < w < wp] and 7 samples in the 
stopband [ws < w < m]. From (7.36) we have 


H, (k) = [1,1,1,0,...,0,1, 1] 
Sa 


15 zeros 


Since M = 20, a 20-1 9.5 and since this is a Type-2 linear-phase filter, 
from (7.37) we have 


Ge = —0.95rk, 0<k<9 
ZH (k) = 20 


+0.957 (20 — k), 10<k<19 


Now from (7.35) we assemble H (k) and from (7.39) determine the impulse 
response h (n). The MATLAB script follows: 


>> M = 20; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 

>> Hrs = [1,1,1,zeros(1,15),1,1]; %Ideal Amp Res sampled 

>> a = [1,1,0,0]; wdl = er eg Ideal Amp Res for plotting 
>> = 0:floor((M-1)/2); = floor((M-1)/2)+1:M-1; 

>> ae = [> Peete ee alpha*(2*pi) /M*(M-k2)]; 

>> H = Hrs.*exp(j*angH); h = real(ifft(H,M)); 

>> [db,mag,pha,grd,w] = freqz_m(h,1); ([Hr,ww,a,L] = Hr_Type2(h); 

>> subplot (2,2,1);plot(wl(1:11)/pi,Hrs(1:11),’o’ ,wdl,Hdr) ; 

>> axis([0,1,-0.1,1.1]); title(’Frequency Samples: M=20’) 

>> xlabel(’frequency in pi units’); ylabel(’Hr(k)’) 
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FIGURE 7.26 Naive frequency sampling design method 


>> subplot(2,2,2); stem(1,h); axis([-1,M,-0.1,0.3]) 

>> title(’Impulse Response’); xlabel(’n’); ylabel(’h(n)’); 

>> subplot(2,2,3); plot (ww/pi,Hr,wl(1:11)/pi,Hrs(1:11),’o’); 

>> axis([0,1,-0.2,1.2]); title(’Amplitude Response’) 

>> xlabel(’frequency in pi units’); ylabel(’Hr(w)’) 

>> subplot (2,2,4);plot(w/pi,db); axis([0,1,-60,10]); grid 

>> title(’Magnitude Response’); xlabel(’frequency in pi units’); 
>> ylabel(’Decibels’) ; 


The time- and the frequency-domain plots are shown in Figure 7.26. Observe 
that the minimum stopband attenuation is about 16 dB, which is clearly unac- 
ceptable. If we increase M, then there will be samples in the transition band, 
for which we do not precisely know the frequency response. Therefore the naive 
design method is seldom used in practice. 


7.4.2 OPTIMUM DESIGN METHOD 

To obtain more attenuation, we will have to increase M and make the 
transition band samples free samples—that is, we vary their values to 
obtain the largest attenuation for the given M and the transition width. 
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This problem is known as an optimization problem, and it is solved using 
linear programming techniques. We demonstrate the effect of transition 
band sample variation on the design using the following example. 


EXAMPLE 7.15 Using the optimum design method, design a better lowpass filter of Example 
7.14. 


Solution Let us choose M = 40 so that we have one sample in the transition band 


0.27 < w < 0.37. Since wi = 27/40, the transition band samples are at k = 5 
and at k = 40 — 5 = 35. Let us denote the value of these samples by Ti, 
0 < Tı < 1; then the sampled amplitude response is 


H, (k) = [1,1,1,1,1,T1,0,...,0, T1, 1,1,1,1] 
x 


29 zeros 
Since a = 40—1 = 19.5, the samples of the phase response are 
20 
—19.5— k = —0.975rk, 0< k < 19 
LH (k) = 40 


+0.9757 (40 — k) , 20 < k < 39 


Now we can vary Tı to get the best minimum stopband attenuation. This will 
result in the widening of the transition width. We first see what happens when 
Tı = 0.5 using the following MATLAB script. 


7h tal = 0.5 

>> M = 40; alpha = (M-1)/2; 

>> Hrs = [ones(1,5),0.5,zeros(1,29) ,0.5,ones(1,4)]; 
>> k1 = 0:floor((M-1)/2); k2 = floor((M-1)/2)+1:M-1; 
>> angH = [-alpha*(2*pi)/M*k1, alpha*(2*pi) /M*(M-k2)]; 
>> H = Hrs.*exp(j*angH) ; 

>> h = real(ifft(H,M)); 


From the plots of this design in Figure 7.27, we observe that the minimum 
stopband attenuation is now 30 dB, which is better than the naive design at- 
tenuation but is still not at the acceptable level of 50 dB. The best value for Tı 
was obtained by varying it manually (although more efficient linear program- 
ming techniques are available, these were not used in this case), and the near 
optimum solution was found at Tı = 0.39. The resulting filter is a obtained 
using the following MATLAB script. 


% T1 = 0.39 

>> M = 40; alpha = (M-1)/2; 

>> Hrs = [ones(1,5),0.39,zeros(1,29) ,0.39,ones(1,4)]; 
>> k1 = 0:floor((M-1)/2); k2 = floor((M-1)/2)+1:M-1; 
>> angH = [-alpha*(2*pi)/M*k1, alpha*(2*pi) /M*(M-k2)]; 
>> H = Hrs.*exp(j*angH); h = real(ifft(H,M)); 
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FIGURE 7.27 Optimum frequency design method: Tı = 0.5 


From the plots in Figure 7.28, we observe that the optimum stopband atten- 
uation is 43 dB. It is obvious that to further increase the attenuation, we wil 
have to vary more than one sample in the transition band. 


Clearly, this method is superior in that by varying one sample we 
can get a much better design. In practice the transition bandwidth is 
generally small, containing either one or two samples. Hence we need to 
optimize at most two samples to obtain the largest minimum stopband 
attenuation. This is also equivalent to minimizing the maximum side-lobe 
magnitudes in the absolute sense. Hence this optimization problem is also 
called a minimaz problem. This problem is solved by Rabiner et al. [24], 
and the solution is available in the form of tables of transition values. 
A selected number of tables are also available in [23, Appendix B]. This 
problem can also be solved in MATLAB, but it would require the use of 
the Optimization toolbox. We will consider a more general version of this 
problem in the next section. We now illustrate the use of these tables in 
the following examples. 
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FIGURE 7.28 Optimum frequency design method: Tı = 0.39 


EXAMPLE 7.16 Let us revisit our lowpass filter design in Example 7.14. We will solve it using two 
samples in the transition band so that we can get a better stopband attenuation. 


Solution Let us choose M = 60 so that there are two samples in the transition band. Let 
the values of these transition band samples be Tı and T2. Then H, (w) is given 
by 


H (w) = [1,...,1, Ti, T2,0,...,0, Te, Fy 22. 1] 
ay ae ~ 
7 ones 43 zeros 6 ones 


From tables in [22, Appendix B] Tı = 0.5925 and T2 = 0.1099. Using these 
values, we use MATLAB to compute h (n). 


>> M = 60; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 

>> Hrs = [ones(1,7),0.5925,0.1099,zeros(1,43),0.1099,0.5925,ones(1,6)]; 
>> Hdr = [1,1,0,0]; wdl = [0,0.2,0.3,1]; 

>> k1 = 0:floor((M-1)/2); K2 = floor((M-1)/2)+1:M-1; 

>> angH = [-alpha*(2*pi)/M*k1, alpha*(2*pi) /M*(M-k2)]; 

>> H = Hrs.*exp(j*angH); h = real(ifft(H,M)); 

>> [db,mag,pha,grd,w] = freqz_m(h,1); [Hr,ww,a,L] = Hr_Type2(h); 
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FIGURE 7.29 Lowpass filter design plots in Example 7.16 


The time- and the frequency-domain plots are shown in Figure 7.29. The min- 
imum stopband attenuation is now at 63 dB, which is acceptable. 


EXAMPLE 7.17 Design the bandpass filter of Example 7.10 using the frequency sampling tech- 
nique. The design specifications are these: 


lower stopband edge: wis = 0.27, As = 60 dB 
lower passband edge: wip = 0.357, Rp = 1 dB 
upper passband edge: we, = 0.657 Rp = 1 dB 


upper stopband edge: we, = 0.8% As = 60 dB 


Solution Let us choose M = 40 so that we have two samples in the transition band. 
Let the frequency samples in the lower transition band be Tı and T2. Then the 
samples of the amplitude response are 

H, (w) = [0,...,0,71,72,1,...,1,72,71,0,...,0,T1, 72,1,...,1,72,71,0,...,0] 
—— Sa’ Sa’ SS’ SS 


5 id 9 A: 4 
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FIGURE 7.30 Bandpass filter design plots in Example 7.17 


The optimum values of Tı and T for M = 40 and seven samples in the passband 
[23, Appendix B] are 


Tı = 0.109021, T = 0.59417456 


The MATLAB script is 


>> M = 40; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 

>> T1 = 0.109021; T2 = 0.59417456; 

>> Hrs=[zeros(1,5) ,T1,T2,ones(1,7) ,T2,T1,zeros(1,9) ,T1,T2,ones(1,7) ,T2,T1,zeros(1,4)]; 
>> Hdr = [0,0,1,1,0,0]; wdl = [0,0.2,0.35,0.65,0.8,1]; 

>> k1 = 0:floor((M-1)/2); K2 = floor((M-1)/2)+1:M-1; 

>> angH = [-alpha*(2*pi)/M*k1, alpha*(2*pi) /M*(M-k2)]; 

>> H = Hrs.*exp(j*xangH); h = real(ifft(H,M)); 

>> [db,mag,pha,grd,w] = freqz_m(h,1); [Hr,ww,a,L] = Hr_Type2(h) ; 


The plots in Figure 7.30 show an acceptable bandpass filter design. 


EXAMPLE 7.18 Design the following highpass filter: 
Stopband edge: ws = 0.67 As = 50 dB 


Passband edge: wp = 0.827 Rp = 1 dB 
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Solution Recall that for a highpass filter M must be odd (or Type-1 filter). Hence we 
will choose M = 33 to get two samples in the transition band. With this choice 
of M it is not possible to have frequency samples at ws and wp. The samples of 
the amplitude response are 


H, (k) = [0,...,0,71, T2,1,...,1,72,7T%,0,...,0] 
—— SS’ SS 
ii 8 10 
while the phase response samples are 


33—127 32 
= SBS 
z gh = Rg OSHS 16 


ZH (k) = 39 
= —k 17 < k < 32 

+337 (33 ), TSKESB 

The optimum values of transition samples are Tı = 0.1095 and Tə = 0.598. 


Using these values, the MATLAB design is given in the following script. 


>> M = 33; alpha = (M-1)/2; 1 = O:M-1; wl = (2*pi/M)*1; 

>> Ti = 0.1095; T2 = 0.598; 

>> Hrs = [zeros(1,11) ,T1,T2,ones(1,8) ,T2,T1,zeros(1,10)]; 

>> ee = [0,0,1,1]; wdl = ee 

>> = 0:floor((M-1)/2); = floor((M-1)/2)+1:M-1; 

>> angH = [- eaten alpha*(2*pi) /M*(M-k2)] ; 

>> H = Hrs.*exp(j*angH); h = real(ifft(H,M)); 

>> [db,mag,pha,grd,w] = freqz_m(h,1); ([Hr,ww,a,L] = Hr_Type1(h); 


The time- and the frequency-domain plots of the design are shown in 
Figure 7.31. 


EXAMPLE 7.19 Design a 33-point digital differentiator based on the ideal differentiator of (7.31) 
given in Example 7.12. 


Solution From (7.31) the samples of the (imaginary-valued) amplitude response are given 
by 
+j rk, b=0,...,[ =| 
PEEVES: 0 op. M-1 
j (M—R), pal |+ oMi 


and for linear phase the phase samples are 


Morys otk, k=0,...,| | 
CE ea M-1 
Ti a(M—k), k=| | +1. ,M-1 
Therefore 


H (k) =jH,(k)2“2™, O<k<M-—1. and h(n) =IDFT[H(k)] 
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FIGURE 7.31 Highpass filter design plots in Example 7.18 


MATLAB script: 


>> M = 33; alpha = (M-1)/2; Dw = 2*pi/M; 1 = 0:M-1; wl = Dw*l; 

>> k1 = 0:floor((M-1)/2); k2 = floor((M-1)/2)+1:M-1; 

>> Hrs = [j*Dw*k1,-j*Dw*(M-k2)]; 

>> angH = [-alpha*Dw*k1, alpha*Dw*(M-k2)]; 

>> H = Hrs.*exp(j*xangH); h = real(ifft(H,M)); ([Hr,ww,a,P]=Hr_Type3(h) ; 


The time- and the frequency-domain plots are shown in Figure 7.32. We observe 
that the differentiator is not a full-band differentiator. 


EXAMPLE 7.20 Design a 51-point digital Hilbert transformer based on the ideal Hilbert trans- 
former of (7.32). 


Solution From (7.32) the samples of the (imaginary-valued) amplitude response are 
given by 


; M-1 
Sheba 5 | 
jH, (k) = <0, k=O 


+j, k= [FtM 
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FIGURE 7.32 Differentiator design plots in Example 7.19 


Since this is a Type-3 linear-phase filter, the amplitude response will be zero 
at w = m. Hence to reduce the ripples, we should choose the two samples (in 
transition bands) near w = 7 optimally between 0 and j. Using our previous 
experience, we could select this value as 0.397. The samples of the phase response 
are selected similar to those in Example 7.19. 


MATLAB script: 


>> M = 51; alpha = (M-1)/2; Dw = 2*pi/M; 1 = 0:M-1; wl = Dw*l; 

>> k1 = 0:floor((M-1)/2); k2 = floor((M-1)/2)+1:M-1; 

>> Hrs = [0,-j*ones(1, (M-3)/2) ,-0.39j,0.39j, j*ones(1, (M-3)/2)]; 

>> angH = [-alpha*Dw*k1, alpha*Dw*(M-k2)]; 

>> H = Hrs.*exp(j*xangH); h = real(ifft(H,M)); ([Hr,ww,a,P]=Hr_Type3(h) ; 


The plots in Figure 7.33 show the effect of the transition band samples. 


The SP toolbox provides a function called fir2 which combines fre- 
quency sampling technique with the window technique to design arbitrary 
shaped magnitude response FIR filters. After computing filter impulse 
response using the naive design method, fir2 then applies a selected 
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FIGURE 7.33 Digital Hilbert transformer design plots in Example 7.20 


window to minimize ripples near the band-edge frequencies. This func- 
tion’s syntax also has several forms including: 


e h = fir2(N,f,m) designs an Nth-order (N = M—1) lowpass FIR filter 
and returns the impulse response in vector h. The desired magnitude 
response of the filter is supplied in vectors f and m, which must be 
of the same length. The vector f contains normalized frequencies in 
the range from 0 to 1, where 1 corresponds to m rad/sample. The first 
value of f must be 0 and the last value 1. The vector m, contains the 
samples of the desired magnitude response at the values specified in f. 
The desired frequency response is then interpolated onto a dense, evenly 
spaced grid of length 512. Thus, this syntax corresponds to the naive 
design method. 

e h = fir2(N,f,m,window) uses the vector window of length N+1 ob- 
tained from one of the specified MATLAB window function. The de- 
fault window function used is the Hamming window. 

e h = fir2(N,f,m,npt) orh = fir2(N,f,m,npt,window) specifies the 
number of points, npt, for the grid onto which fir2 interpolates the 
frequency response. The default npt value is 512. 
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Note that the fir2 does not implement the classic optimum frequency 
sampling method. By incorporating window design, fir2 has found an al- 
ternative (and somewhat clever) approach to do away with the optimum 
transition band values and the associated tables. By densely sampling 
values in the entire band, interpolation errors are reduced (but not mini- 
mized), and stopband attenuation is increased to an acceptable level. How- 
ever, the basic design is contaminated by the window operation; hence, 
the frequency response does not go through the original sampled values. It 
is more suitable for designing FIR filters with arbitrary shaped frequency 
responses. 

The type of frequency sampling filter that we considered is called a 
Type-A filter, in which the sampled frequencies are 


20 
wk = afk: 0<k<M-1 


There is a second set of uniformly spaced samples given by 


Qn (k + 5) 
oo a 
This is called a Type-B filter, for which a frequency sampling structure is 
also available. The expressions for the magnitude response H(e”) and the 
impulse response h(n) are somewhat more complicated and are available 
in Proakis and Manolakis [23]. Their design can also be done in MATLAB 
using the approach discussed in this section. 


Wr 0<k<M-1 


7.5 OPTIMAL EQUIRIPPLE DESIGN TECHNIQUE 
See eae 


The last two techniques—namely, the window design and the frequency 
sampling design—were easy to understand and implement. However, they 
have some disadvantages. First, we cannot specify the band frequencies 
Wp and ws precisely in the design; that is, we have to accept whatever 
values we obtain after the design. Second, we cannot specify both 6, and 
62 ripple factors simultaneously. Either we have 6, = 62 in the window 
design method, or we can optimize only 62 in the frequency sampling 
method. Finally, the approximation error—that is, the difference between 
the ideal response and the actual response—is not uniformly distributed 
over the band intervals. It is higher near the band edges and smaller in 
the regions away from band edges. By distributing the error uniformly, 
we can obtain a lower-order filter satisfying the same specifications. For- 
tunately, a technique exists that can eliminate these three problems. This 
technique is somewhat difficult to understand and requires a computer 
for its implementation. 
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For linear-phase FIR filters, it is possible to derive a set of conditions 
for which it can be proved that the design solution is optimal in the sense 
of minimizing the maximum approximation error (sometimes called the 
minimaz or the Chebyshev error). Filters that have this property are called 
equiripple filters because the approximation error is uniformly distributed 
in both the passband and the stopband. This results in lower-order 
filters. 

In the following we first formulate a minimax optimal FIR design 
problem and discuss the total number of maxima and minima (collec- 
tively called extrema) that one can obtain in the amplitude response of 
a linear-phase FIR filter. Using this, we then discuss a general equiripple 
FIR filter design algorithm, which uses polynomial interpolation for its so- 
lution. This algorithm is known as the Parks-McClellan algorithm, and it 
incorporates the Remez exchange algorithm for polynomial solution. This 
algorithm is available as a subroutine on many computing platforms. In 
this section we will use MATLAB to design equiripple FIR filters. 


7.5.1 DEVELOPMENT OF THE MINIMAX PROBLEM 
Earlier in this chapter we showed that the frequency response of the four 
cases of linear-phase FIR filters can be written in the form 


M 


H(t”) = etf emi =” H, (w) 


where the values for 6 and the expressions for H,(w) are given in 
Table 7.2. 


TABLE 7.2 Amplitude response and G-values for linear-phase FIR filters 


Linear-phase FIR Filter Type b H, (e®) 
(M~1)/2 
Type-1: M odd, symmetric h(n) 0 So a(n) coswn 
0 
M/2 
Type-2: M even, symmetric h(n) 0 >> b(n) cos [w(n — 1/2)] 
1 
A (M-—1)/2 
Type-3: M odd, antisymmetric h(n) 5 c(n) sinwn 
T 
M/2 


Type-4: M even, antisymmetric h(n) 


N| a 
& 
= 
a, 
D 
A 
3 
| 
E 
are 
> 
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Using simple trigonometric identities, each expression for H,(w) can 

be written as a product of a fixed function of w (call this Q(w)) and a 

function that is a sum of cosines (call this P(w)). For details see Proakis 
and Manolakis [23] and Problems P7.2—P7.5. Thus 

H,(w) = Q(w)P() (7.40) 


where P(w) is of the form 
P(w) = X a(n) coswn (7.41) 
and Q(w), L, P(w) for the four cases are given in Table 7.3. 


TABLE 7.3 Q(w), L, and P(w) for linear-phase FIR filters 


LP FIR Filter Type Q(w) L P(w) 
M-1 £ 
Type-1 1 5 X a(n) coswn 
0 
L ~ 
Type-2 cos 2 “Mi: 1 X b(n) coswn 
2 2 - 
= L 
Type-3 sinw -a 3 X en) coswn 
0 
L ~ 
Type-4 sin = x —1 X d(n) coswn 
0 


The purpose of the previous analysis was to have a common form 
for H,(w) across all four cases. It makes the problem formulation much 
easier. To formulate our problem as a Chebyshev approximation problem, 
we have to define the desired amplitude response Har(w) and a weighting 
function W(w), both defined over passbands and stopbands. The weight- 
ing function is necessary so that we can have an independent control over 
6, and 62. The weighted error is defined as 


E(w) 2 W (w) [Har (w) — H (w), wes £ [0, wp] U [ws, 7] (7.42) 


These concepts are made clear in the following set of figures. It shows a 
typical equiripple filter response along with its ideal response. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Optimal Equiripple Design Technique 361 


Amplitude Response of an Equiripple Filter 
T 


f 
1.10 J 
1.0 Ideal Response 1 
0.90 al 
0.05- 
0.0 + Ideal Response 
-0.05 F 
i 1 
0 0.3 0.5 1 


frequency in n units 


The error [Har (w) — H, (w)] response is shown here. 


Error Function 
T 


2 
oO 
T 
1 


| 

md 

[e] 

a 
T 


| 
0 0.3 0.5 1 
frequency in m units 


Now if we choose 


ba in the passband 
W (w) = 4 êi (7.43) 


1, in the stopband 
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Then the weighted error E(w) response is 


Weighted Error Function 


weight = 0.5 weight = 1.0 


1 | 
0 0.3 0.5 1 
frequency in m units 


Thus the maximum error in both the passband and stopband is 69. There- 
fore, if we succeed in minimizing the maximum weighted error to 62, we 
automatically also satisfy the specification in the passband to 6,. Substi- 
tuting H,(w) from (7.40) into (7.42), we obtain 


E (w) = W (w) [Har (w) — Q (w) P (w)] 


= Ww w)Qw) EE- Pw, wes 
If we define 
WÈW) and fia (o) Ê Hee 
then we obtain 
E(w) = Ww) |Har(w)— Pw)], wes (7.44) 


Thus we have a common form of E(w) for all four cases. 


Problem statement The Chebyshev approximation problem can now 
be defined as: 


Determine the set of coefficients a(n) or b(n) or č(n) or d(n) [or equiva- 
lently a(n) or b(n) or c(n) or d(n)] to minimize the maximum absolute 
value of E (w) over the passband and stopband, i.e., 


i E 7.4 
Baca: [magi | ( 5) 
Now we have succeeded in specifying the exact wp, ws, 61, and 62. In 
addition the error can now be distributed uniformly in both the passband 
and stopband. 
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7.5.2 CONSTRAINT ON THE NUMBER OF EXTREMA 

Before we give the solution to this above problem, we will first discuss 
the issue: how many local maxima and minima exist in the error func- 
tion E(w) for a given M-point filter? This information is used by the 
Parks-McClellan algorithm to obtain the polynomial interpolation. The 
answer is in the expression P(w). From (7.41) P (w) is a trigonometric 
function in w. Using trigonometric identities of the form 


cos (2w) = 2cos? (w) — 1 
cos (3w) = 4 cos? (w) — 3 cos (w) 


P (w) can be converted to a trigonometric polynomial in cos (w), which 
we can write (7.41) as 


P (w) = X B(n) cos” w (7.46) 


EXAMPLE 7.21 Let h(n) = [1 2,3, 4,3, 2, 1] . Then M = 7 and h(n) is symmetric, which 
means that we have a Type-1 linear-phase filter. Hence L = (M — 1)/2 = 3. 
Now from (7.7) 


a(n) = a(n) = 2h(3- n), 1<n< 2; and a(0) = a(0) = h(3) 
or a(n) = 5 [4,6, 4, 2]. Hence 
3 
P(w) = yo a(n) cos wn = 5 (4+ 6cosw + 4 cos 2w + 2 cos 3w) 
0 
= = {4 + 6cosw + 4(2 cos? w —1)+ 2(4 cos? w — 3cosw)} 


3 
= 8 2 8 3 2A n 
0+0 + 7 cos’ w + gz cos” w > B(n) cos” w 
0 


8 8 
or B(n) = [0.0, 5? =|: 

From (7.46) we note that P(w) is an Lth-order polynomial in cos(w). Since 
cos(w) is a monotone function in the open interval 0 < w < 7, then it follows 
that the Lth-order polynomial P(w) in cos(w) should behave like an ordinary 
Lth-order polynomial P(x) in x.Therefore P(w) has at most (i.e., no more than) 
(L — 1) local extrema in the open interval 0 < w < r. For example, 


2 1+ cos 2w 
cos“ (w) = =a 


has only one minimum at w = 7/2. However, it has three extrema in the closed 
interval 0 < w < 7 (i.e., a maximum at w = 0, a minimum at w = 7/2, and 
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FIGURE 7.34 Amplitude response and the error function in Example 7.22 


a maximum at w = 7). Now if we include the end points w = 0 and w = 7, 
then P (w) has at most (L + 1) local extrema in the closed interval 0 < w < 7. 
Finally, we would like the filter specifications to be met exactly at band edges 
wp and ws. Then the specifications can be met at no more than (L + 3) extremal 
frequencies in the 0 < w < m interval. 


Conclusion The error function E(w) has at most (L +3) extrema in S. 


EXAMPLE 7.22 Let us plot the amplitude response of the filter given in Example 7.21 and count 
the total number of extrema in the corresponding error function. 


Solution The impulse response is 
h(n) = =7[1,2,3,4,3,2,1], M=7 or L=3 
and a(n) = 75[4, 6, 4,2] and (n) = [0, 0, Š, 4] from Example 7.21. Hence 
= 2 Be ag 
P(w) = 15 ©% w+ 15 8 Y 


which is shown in Figure 7.34. Clearly, P (w) has (L — 1) = 2 extrema in the 
open interval 0 < w < m. Also shown in Figure 7.34 is the error function, which 
has (L + 3) = 6 extrema. 
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Let us now turn our attention to the problem statement and equa- 
tion (7.45). It is a well-known problem in approximation theory, and the 
solution is given by the following important theorem. 


= THEOREM1 Alternation Theorem 
Let S be any closed subset of the closed interval [0,7]. In order that 
P(w) be the unique minimax approximation to Har(w) on S, it is necessary 
and sufficient that the error function E(w) exhibit at least (L +2) “alter- 
nations” or extremal frequencies in S; that is, there must exist (L + 2) 
frequencies w; in S such that 


E (wi) = —E (wi-1) = + max |E (w)| (7.47) 


I> 


+6, Vwo < Wy <- <w ES 


Combining this theorem with our earlier conclusion, we infer that 
the optimal equiripple filter has either (L + 2) or (L + 3) alternations 
in its error function over S. Most of the equiripple filters have (L + 2) 
alternations. However, for some combinations of wp and ws, we can get 
filters with (L+3) alternations. These filters have one extra ripple in their 
response and hence are called Extraripple filters. 


7.5.3 PARKS-McCLELLAN ALGORITHM 

The alternation theorem ensures that the solution to our minimax ap- 
proximation problem exists and is unique, but it does not tell us how 
to obtain this solution. We know neither the order M (or equivalently, 
L), nor the extremal frequencies w;, nor the parameters {a(n)}, nor the 
maximum error 6. Parks and McClellan [20] provided an iterative solution 
using the Remez exchange algorithm. It assumes that the filter length M 
(or L) and the ratio 62/6, are known. If we choose the weighting function 
as in (7.43), and if we choose the order M correctly, then 6 = 62 when 
the solution is obtained. Clearly, 6 and M are related; the larger the M, 
the smaller the 6. In the filter specifications 6), 62, wp, and ws are given. 
Therefore M has to be assumed. Fortunately, a simple formula, due to 
Kaiser, exists for approximating M. It is given by 


^ —20 log10 vV 6169 — 13 
A = 
2.285Aw 


+1; Aw = ws— wp (7.48) 


The Parks-McClellan algorithm begins by guessing (L + 2) extremal 
frequencies {w;} and estimating the maximum error 6 at these frequencies. 
It then fits an Lth-order polynomial (7.46) through points given in (7.47). 
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Local maximum errors are determined over a finer grid, and the extremal 
frequencies {w;} are adjusted at these new extremal values. A new Lth- 
order polynomial is fit through these new frequencies, and the procedure 
is repeated. This iteration continues until the optimum set {w;} and the 
global maximum error 6 are found. The iterative procedure is guaranteed 
to converge, yielding the polynomial P(w). From (7.46) coefficients G(n) 
are determined. Finally, the coefficients a(n) as well as the impulse re- 
sponse h(n) are computed. This algorithm is available in MATLAB as 
the firpm function, which is described shortly. 

Since we approximated M, the maximum error 6 may not be equal to 
6. If this is the case, then we have to increase M (if 6 > 62) or decrease 
M (if 6 < 62) and use the firpm algorithm again to determine a new 
6. We repeat this procedure until 6 < 62. The optimal equiripple FIR 
filter, which satisfies all the three requirements discussed earlier, is now 
determined. 


7.5.4 MATLAB IMPLEMENTATION 
The Parks-McClellan algorithm is available in MATLAB as a function 
called firpm, the most general syntax of which is 


[h] = firpm(N,f,m,weights,ftype) 


There are several versions of this syntax 


e [h] = firpm(N,f,m) designs an Nth-order (note that the length of the 
filter is M = N +1) FIR digital filter whose frequency response is 
specified by the arrays f and m. The filter coefficients (or the impulse 
response) are returned in array h of length M. The array f contains 
band-edge frequencies in units of m, that is, 0.0 < f < 1.0. These fre- 
quencies must be in increasing order, starting with 0.0 and ending with 
1.0. The array m contains the desired magnitude response at frequen- 
cies specified in f. The lengths of f and m arrays must be the same and 
must be an even number. The weighting function used in each band 
is equal to unity, which means that the tolerances (6;’s) in every band 
are the same. 

e [h] = firpm(N,f,m,weights) is similar to the preceding case except 
that the array weights specifies the weighting function in each band. 

e [h] = firpm(N,f,m,ftype) is similar to the first case except when 
ftype is the string ‘differentiator’ or ‘hilbert’, it designs digi- 
tal differentiators or digital Hilbert transformers, respectively. For the 
digital Hilbert transformer, the lowest frequency in the f array should 
not be 0, and the highest frequency should not be 1. For the digital 
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differentiator, the m vector does not specify the desired slope in each 
band but the desired magnitude. 

e [h] = firpm(N,f,m,weights,ftype) is similar to the above case ex- 
cept that the array weights specifies the weighting function in each 
band. 


To estimate the filter order N, the SP toolbox provides the function 
firpmord, which also estimates other parameters that can be used in the 
firpm function. The basic syntax is 


(N,£0,m0,weights] = firpmord(f,m,delta) ; 


The function computes the window order N, the normalized frequency 
band edges in £0, amplitude response in a0, and the band weights in 
weights. The vector f is a vector of normalized band edges and m is a 
vector specifying the desired amplitude on the bands defined by f. The 
length of f is two less than twice the length of m; i.e., f does not contain 0 
or 1. The vector delta specifies tolerances in each band (not in decibels). 
The estimated parameters can now be used in the firpm function. 

As explained during the description of the Parks-McClellan algorithm, 
we have to first guess the order of the filter using (7.48) to use the function 
firpm. After we obtain the filter coefficients in array h, we have to check 
the minimum stopband attenuation and compare it with the given A, 
and then increase (or decrease) the filter order. We have to repeat this 
procedure until we obtain the desired A,. We illustrate this procedure 
in the following several MATLAB examples. These examples also use the 
ripple conversion function db2delta, which is developed in Problem P7.1. 


EXAMPLE 7.23 Let us design the lowpass filter described in Example 7.8 using the Parks- 
McClellan algorithm. The design parameters are 


Wp =0.2r, Ry =0.25 dB 
ws =0.30, A, = 50 dB 


We provide a MATLAB script to design this filter. 


>> wp = 0.2*pi; ws = 0.3*pi; Rp = 0.25; As = 50; 

>> [delta1,delta2] db2delta(Rp,As); 

>> [N,f,m, weights] = firpmord([wp,ws]/pi, [1,0] , [delta1,delta2]); 
>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> delta_w = 2*pi/1000; wsi=ws/delta_w+1; wpi = wp/delta_w; 

>> Asd = -max(db(wsi:1:501)) 

Asd = 47.8404 
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>> N = N+1 

N = 43 

>> h = firpm(N,f,m,weights); [db,mag,pha,grd,w] = freqz_m(h,[1]); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 48.2131 

>> N = N+1 

N= 44 

>> h = firpm(N,f,m,weights); [db,mag,pha,grd,w] = freqz_m(h,[1]); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 48.8689 

>> N = N+1 

N = 45 

>> h = firpm(N,f,m,weights); [db,mag,pha,grd,w] = freqz_m(h,[1]); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 49.8241 

>> N = N+1 

N = 46 

>> h = firpm(N,f,m,weights); [db,mag,pha,grd,w] = freqz_m(h,[1]); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 51.0857 

>> M = N+1 

M = 47 


Note that we stopped this iterative procedure when the computed stopband 
attenuation exceeded the given stopband attenuation As, and the optimal value 
of M was found to be 47. This value is considerably lower than the window 
design techniques (MWM = 61 for a Kaiser window) or the frequency sampling 
technique (M = 60). In Figure 7.35 we show the time- and the frequency- 
domain plots of the designed filter along with the error function in both the 
passband and the stopband to illustrate the equiripple behavior. 


EXAMPLE 7.24 Let us design the bandpass filter described in Example 7.10 using the Parks- 
McClellan algorithm. The design parameters are: 


Wis = 0.27 
; R,=1dB 
Wip = 0.357 
W2p = 0.657 
; As = 60 db 
Ww, = 0.87 
Solution The following MATLAB script shows how to design this filter. 


>> wsl = 0.2*pi; wp1 = 0.35*pi; wp2 = 0.65*pi; ws2 = 0.8*pi; 
ee Maye) = 11.03 hes > (hoe 
>> [deltal,delta2] = db2delta(Rp,As) ; 
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>> f = [wsi,wp1,wp2,ws2]/pi; m = [0,1,0]; delta = [delta2,deltai1,delta2] ; 
>> [N,f,m,weights] = firpmord(f,m,delta); N 

N = 26 

>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> delta_w=2*pi/1000; 

>> wsli=floor(ws1/delta_w)+1; wp1li = floor(wpi/delta_w)+1; 
>> ws2i=floor(ws2/delta_w)+1; wp2i floor (wp2/delta_w)+1; 
>> Asd = -max(db(1:1:ws1i)) 

Asd = 54.7756 

>> N = N+1; 

>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> Asd = -max(db(1:1:ws1i)) 

Asd = 56.5910 

>> N = N+1; 

>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

Asd = -max(db(1:1:ws1i)) 

>> Asd = 61.2843 

>> M = N+1 

M = 29 
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FIGURE 7.35 Plots for equiripple lowpass FIR filter in Example 7.23 
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FIGURE 7.36 Plots for equiripple bandpass FIR filter in Example 7.24 


The optimal value of M was found to be 29. The time- and the frequency-domain 
plots of the designed filter are shown in Figure 7.36. 


EXAMPLE 7.25 Design a highpass filter that has the following specifications: 
ws =0.67, As = 50 dB 
wp = 0.757, Rp = 0.5 dB 


Solution Since this is a highpass filter, we must ensure that the length M is an odd 
number. This is shown in the following MATLAB script. 


>> ws = 0.6*pi; wp = 0.75*pi; Rp = 0.5; As = 50; 

>> [deltal,delta2] db2delta(Rp,As) ; 

>> [N,f,m,weights] = firpmord([ws,wp]/pi, [0,1], [delta2,deltai]); N 
N = 26 

>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> delta_w = 2*pi/1000; wsi=ws/delta_w; wpi = wp/delta_w; 
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>> Asd = -max(db(1:1:wsi)) 

Asd = 49.5918 

>> N = N+2; 

>> h = firpm(N,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 
>> Asd = -max(db(1:1:wsi)) 

>> Asd = 50.2253 

>> M = N+1 


Note also that we increased the value of N by two to maintain its even value. 
The optimum M was found to be 29. The time- and the frequency-domain plots 
of the designed filter are shown in Figure 7.37. 


EXAMPLE 7.26 In this example we will design a “staircase” filter, which has 3 bands with 
different ideal responses and different tolerances in each band. The design spec- 
ifications are 


Band-1: 0 <w < 0.37, Ideal gain = 1, Tolerance 6; = 0.01 


Band-2: 0.4m < w < 0.77, Ideal gain = 0.5, Tolerance 62 = 0.005 
Band-3: 0.87 <w <7, Ideal gain=0, ‘Tolerance 63 = 0.001 
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FIGURE 7.37 Plots for equiripple highpass FIR filter in Example 7.25 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 


Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


372 Chapter 7 m FIR FILTER DESIGN 


Solution The following MATLAB script describes the design procedure. 


>> w1 = 0; w2 = 0.3*pi; deltal = 0.01; 

>> w3 = 0.4*pi; w4 = 0.7*pi; delta2 = 0.005; 
>> w5 = 0.8*pi; w6 = pi; delta3 = 0.001; 

>> weights = [delta3/delta1 delta3/delta2 1]; 
>> Dw = min((w3-w2), (w5-w3)); 


>> M = ceil((-20*log10((deltai*delta2*delta3) ~ (1/3) )-13)/(2.285*Dw)+1) 
>> M = 51 

>> f = [0 w2/pi w3/pi w4/pi w5/pi 1]; 

>>m= [1 10.5 0.5 0 0]; 

>> h = firpm(M-1,f,m,weights) ; 


>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> delta_w = 2*pi/1000; 

>> wii=floor(wi/delta_w)+1; w2i = floor(w2/delta_w)+1; 
>> w3i=floor(w3/delta_w)+1; w4i floor (w4/delta_w)+1; 
>> w5i=floor(w5/delta_w)+1; w6i floor (w6/delta_w)+1; 
>> Asd = -max(db(w5i:w6i)) 

Asd = 62.0745 

>> M = M-1; h = firpm(M-1,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> Asd = -max(db(w5i:w6i)) 

Asd = 60.0299 

>> M = M-1; h = firpm(M-1,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> Asd = -max(db(w5i:w6i)) 

Asd = 60.6068 

>> M 


The time- and the frequency-domain plots of the designed filter are shown in 
Figure 7.38. 


EXAMPLE 7.27 In this example we will design a digital differentiator with different slopes in 
each band. The specifications are 


Band-1: 0<w< 0.27, Slope = 1 sam/cycle 
Band-2: 0.47 < w < 0.67, Slope = 2 sam/cycle 
Band-3: 0.87 <w <7, Slope = 3 sam/cycle 
Solution We need desired magnitude response values in each band. These can be ob- 


tained by multiplying band-edge frequencies in cycles/sam by the slope values 
in sam/cycle 
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FIGURE 7.38 Plots for equiripple staircase FIR filter in Example 7.26 


Band-1: 0< f <0.1, Slope = 1 sam/cycle > 0.0 < |H| < 0.1 

Band-2: 0.2 < f < 0.3, Slope = 2 sam/cycle > 0.4 < |H| < 0.6 

Band-3: 0.4 < f < 0.5, Slope = 3 sam/cycle > 1.2 < |H| < 1.5 
Let the weights be equal in all bands. The MATLAB script is: 


>> f = [0 0.2 0.4 0.6 0.8 1]; % in w/pi unis 
>> m = [0,0.1,0.4,0.6,1.2,1.5]; % magnitude values 
>> h = firpm(25,f,m,’differentiator’) ; 


>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> subplot(2,1,1); stem([0:25],h); title(’Impulse Response’) ; 

>> xlabel(’n’); ylabel(’h(n)’); axis([0,25,-0.6,0.6]) 

>> set(gca, ’XTickMode’, ’manual’, ’XTick’, [0,25]) 

>> set(gca, ’YTickMode’,’manual’, ’YTick’, [-0.6:0.2:0.6]); 

>> subplot (2,1,2); plot(w/(2*pi) ,mag); title(’Magnitude Response’) 

>> xlabel(’Normalized frequency f’); ylabel(’|H|’) 

>> set(gca, ’XTickMode’, ’manual’, ’XTick’ ,f/2) 

>> set(gca,’?YTickMode’, ’manual’,’YTick’,[0,0.1,0.4,0.6,1.2,1.5]); grid 


The frequency-domain response is shown in Figure 7.39. 
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FIGURE 7.39 Plots of the differentiator in Example 7.27 


EXAMPLE 7.28 Finally, we design a Hilbert transformer over the band 0.057 < w < 0.957. 


Solution Since this is a wideband Hilbert transformer, we will choose an odd length for 
our filter (i.e., a Type-3 filter). Let us choose M = 51. The MATLAB script is: 


>> f = [0.05,0.95]; m = [1 1]; h = firpm(50,f,m,’hilbert’); 
>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> subplot(2,1,1); stem([0:50],h); title(’Impulse Response’); 
>> xlabel(’n’); ylabel(’h(n)’); axis([0,50,-0.8,0.8]) 

>> set(gca, ’XTickMode’, ’manual’, ’XTick’, [0,50]) 

>> set (gca, ?>YTickMode’ , manual’, ’YTick’, [-0.8:0.2:0.8]); 

>> subplot(2,1,2); plot(w/pi,mag); title(’Magnitude Response’) 
>> xlabel(’frequency in pi units’); ylabel(’|H|’) 

>> set(gca, ’XTickMode’, ’manual’, ’XTick’,[0,f,1]) 

>> set(gca, ’YTickMode’,’manual’,’YTick’,[0,1]);grid 


The plots of this Hilbert transformer are shown in Figure 7.40. 
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FIGURE 7.40 Plots of the Hilbert transformer in Example 7.28 


7.6 PROBLEMS 
————— ee —— 


P7.1 The absolute and relative (dB) specifications for a lowpass filter are related by (7.1) and 
(7.2). In this problem we will develop a simple MATLAB function to convert one set of 
specifications into another. 


1. Write a MATLAB function to convert absolute specifications 6, and 62 into the relative 
specifications R, and A, in dB. The format of the function should be 


function [Rp,As] = delta2db(deltai,delta2) 
% Converts absolute specs deltal and delta2 into dB specs Rp and As 
% [Rp,As] = delta2db(deltai,delta2) 


Verify your function using the specifications given in Example 7.2. 
2. Write a MATLAB function to convert relative (dB) specifications Rp and As into the 
absolute specifications 6; and 62. The format of the function should be 


function [deltal,delta2] = db2delta(Rp,As) 


% Converts dB specs Rp and As into absolute specs delta1 and delta2 
% [deltai,delta2] = db2delta(Rp,As) 


Verify your function using the specifications given in Example 7.1. 
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P7.2 The Type-1 linear-phase FIR filter is characterized by 
h(n) =h(M—1—n)), 0<n<M-—1, M odd 
Show that its amplitude response H,(w) is given by 


L 


H,(w) = ya a(n)cos(wn), L= 


n=0 


where coefficients {a(n)} are obtained as defined in (7.6). 
P7.3 The Type-2 linear-phase FIR filter is characterized by 
h(n) =h(M-1-n), O0<n<M-—-1, M even 
1. Show that its amplitude response H,.(w) is given by 


M/2 


H,(w) = 5 b(n) cos {w (n z z)} 


n=1 


where coefficients {b(n)} are obtained as defined in (7.10). 
2. Show that H;(w) can be further expressed as 


L 
M 
H, (w) = cos (2) X b(n) cos(wn), L= ae 1 
n=0 
where coefficients b(n) are given by 
b(1) = 6(0) + 46(1), 
: z M 
b(n) = [b(n — 1) +b(n)], DTS A; 


P7.4 The Type-3 linear-phase FIR filter is characterized by 
h(n) = —-h(M-1-n), O<n<M-1, M odd 
1. Show that its amplitude response H,.(w) is given by 


(M-1)/2 


H, (w) = 5 c(n) sin(wn) 


n=l 


where coefficients {c(n)} are obtained as defined in (7.13). 
2. Show that H;(w) can be further expressed as 
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where coefficients č(n) are given by 


e(1) = &(0) — 3č(1), 


(ME) - BOS), 


P7.5 The Type-4 linear-phase FIR filter is characterized by 


h(n) = —-h(M-1-n), O<n<M-1, M even 
1. Show that its amplitude response H,(w) is given by 


M/2 


H,(w) = X d(n) sin {w (n — 3)} 


n=1 


where coefficients {d(n)} are obtained as defined in (7.16). 
2. Show that the above H;(w) can be further expressed as 


H,(w) = sin (2) X din) cos(wn), L= = —1 
where coefficients d(n) are given by 
d(1) = do) — 4d(1), 
d(n) = £[d(n-1)-d(n)], 2<n< 1, 


P7.6 Write a MATLAB function to compute the amplitude response H;(w) given a linear phase 
impulse response h(n). The format of this function should be 


function [Hr,w,P,L] = Ampl_Res(h); 

% Computes Amplitude response Hr(w) and its polynomial P of order L, 
% given a linear-phase FIR filter impulse response h. 

% The type of filter is determined automatically by the subroutine. 
% 

% 


[Hr,w,P,L] = Ampl_Res(h) 
% Hr = Amplitude Response 
frequencies between [0 pi] over which Hr is computed 
Polynomial coefficients 
Order of P 
Linear Phase filter impulse response 


os 
[=r le! tae) E 
HT] 


The function should first determine the type of the linear-phase FIR filter and then use the 
appropriate Hr_Type# function discussed in this chapter. It should also check if the given 
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h(n) is of a linear-phase type. Verify your function on sequences given here. 


h(n) = (0.9)'"~*! cos[r(n — 5)/12] [u(n) — u(n — 11)] 
hu(n) = (0.9)'"~4°! cos[x(n — 4.5) /11] [u(n) — u(n — 10)] 
Ant(n) = (0.9)!"~*! sin[w(n — 5)/12] [u(m) — u(n — 11)] 
hiv(n) = (0.9)!"~*°! sin[a(n — 4.5)/11] [u(n) — u(n — 10)] 
h(n) (0.9)” cos[r(n — 5)/12] [u(n) — u(n — 11)] 


P7.7 Prove the following properties of linear-phase FIR filters. 


1. If H(z) has four zeros at z1 = rel’, Z2 = 1e? 
represents a linear-phase FIR filter. 


2. If H(z) has two zeros at zı = ef? and z2 = e7}? then H(z) represents a linear-phase FIR 


, 23 =re 7, and z4 = teI? then H(z) 


filter. 

3. If H(z) has two zeros at zı =r and 22 = + then H(z) represents a linear-phase FIR 
filter. 

4. If H(z) has a zero at zı = 1 or a zero at z1 = —1 then H(z) represents a linear-phase 
FIR filter. 


5. For each of the sequences given in Problem P7.6, plot the locations of zeros. Determine 
which sequences imply linear-phase FIR filters. 


P7.8 A notch filter is an LTI system, which is used to eliminate an arbitrary frequency w = wo. 
The ideal linear-phase notch filter frequency response is given by 


j 0 lwl = Wo; P : 
IN, __ ? , 
Ha (e ) = { 1- ei, otherwise. (a is a delay in samples) 


1. Determine the ideal impulse response, ha(n), of the ideal notch filter. 

2. Using ha(n), design a linear-phase FIR notch filter using a length 51 rectangular window 
to eliminate the frequency wo = 7/2 rad/sample. Plot amplitude the response of the 
resulting filter. 

3. Repeat part 2 using a length 51 Hamming window. Compare your results. 


P7.9 Design a linear-phase bandpass filter using the Hann window design technique. The 
specifications are 


lower stopband edge: 0.27 
upper stopband edge: 0.757 
lower passband edge: 0.357 
upper passband edge: 0.557 


As = 40 dB 


Rp = 0.25 dB 


Plot the impulse response and the magnitude response (in dB) of the designed filter. Do not 
use the fir1 function. 


P7.10 Design a bandstop filter using the Hamming window design technique. The specifications are 


lower stopband edge: 0.47 
upper stopband edge: 0.67 
lower passband edge: 0.37 
upper passband edge: 0.77 


As = 50 dB 


R, = 0.2 dB 
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Plot the impulse response and the magnitude response (in dB) of the designed filter. Do not 
use the fir1 function. 


P7.11 Design a bandpass filter using the Hamming window design technique. The specifications are 


lower stopband edge: 0.37 
upper stopband edge: 0.67 
lower passband edge: 0.47 
upper passband edge: 0.57 


As = 50 dB 


R, = 0.5 dB 


Plot the impulse response and the magnitude response (in dB) of the designed filter. Do not 
use the fir1 function. 


P7.12 Design a highpass filter using one of the fixed window functions. The specifications are 


stopband edge: 0.47, As = 50 dB 
passband edge: 0.67, Rp = 0.004 dB 


Plot the zoomed magnitude response (in dB) of the designed filter in the passband to verify 
the passband ripple Rp. Do not use the fir1 function. 


P7.13 Using the Kaiser window method, design a linear-phase FIR digital filter that meets the 
following specifications 


0.975 < |H(e%*)| < 1.025, 0 < w < 0.257 
0 < |H(ef®)| < 0.005, 0.357 < w < 0.657 
0.975 < |H(e%”)| < 1.025, 0.757 < w <a 


Determine the minimum length impulse response h(n) of such a filter. Provide a plot 
containing subplots of the amplitude response and the magnitude response in dB. Do not 
use the fir1 function. 
P7.14 We wish to use the Kaiser window method to design a linear-phase FIR digital filter that 
meets the following specifications: 
0 < |H(e®)| < 0.01, 0 < w < 0.257 
0.95 < |H(ef”)| < 1.05, 0.357 < w < 0.657 
0 < |H(e”)| < 0.01, 0.757 < w < r 


Determine the minimum length impulse response h(n) of such a filter. Provide a plot 
containing subplots of the amplitude response and the magnitude response in dB. Do not 
use the fir1 function. 


P7.15 Design the staircase filter of Example 7.26 using the Kaiser window approach. The 
specifications are 


Band-1: 0 < w < 0.37, Ideal gain = 1, 6, = 0.01 
Band-2: 0.47 < w < 0.77, Ideal gain = 0.5, 62 = 0.005 
Band-3: 0.87 < w < a, Ideal gain = 0, 63 = 0.001 


Compare the filter length of this design with that of Example 7.26. Provide a plot of the 
magnitude response in dB. Do not use the fir1 function. 
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P7.16 Design a bandpass filter using a fixed window design technique that has the minimum 
length and that satisfies the following specifications: 


lower stopband edge = 0.37 A 

upper stopband edge = 0.67 \ Be = ee. 
lower passband edge = 0.47 _ 

upper passband edge = 0.57 \ Aad: 


Provide a plot of the log-magnitude response in dB and stem plot of the impulse response. 
P7.17 Repeat Problem P7.9 using the fir1 function. 
P7.18 Repeat Problem P7.10 using the fir1 function. 
P7.19 Repeat Problem P7.11 using the fir1 function. 
P7.20 Repeat Problem P7.12 using the fir1 function. 
P7.21 Repeat Problem P7.13 using the fir1 function. 
P7.22 Repeat Problem P7.14 using the fir1 function. 


P7.23 Consider an ideal lowpass filter with the cutoff frequency we = 0.37. We want to 
approximate this filter using a frequency sampling design in which we choose 40 samples. 


1. Choose the sample at we equal to 0.5, and use the naive design method to compute h(n). 
Determine the minimum stopband attenuation. 

2. Now vary the sample at w., and determine the optimum value to obtain the largest 
minimum stopband attenuation. 

3. Plot the magnitude responses in dB of the preceding two designs in one plot, and 
comment on the results. 


P7.24 Design the bandstop filter of Problem P7.10 using the frequency sampling method. Choose 
the order of the filter appropriately so that there are two samples in the transition band. 
Use optimum values for these samples. Compare your results with those obtained using the 
fir2 function. 


P7.25 Design the bandpass filter of Problem P7.11 using the frequency sampling method. Choose 
the order of the filter appropriately so that there are two samples in the transition band. 
Use optimum values for these samples. Compare your results with those obtained using the 
fir2 function. 


P7.26 Design the highpass filter of Problem P7.12 using the frequency sampling method. Choose 
the order of the filter appropriately so that there are two samples in the transition band. 
Use optimum values. Compare your results with those obtained using the fir2 function. 


P7.27 Consider the filter specifications given in Figure P7.1. Use the fir2 function and a 
Hamming window to design a linear-phase FIR filter via the frequency sampling method. 
Experiment with the filter length to achieve the required design. Plot the amplitude 
response of the resulting filter. 


P7.28 Design a bandpass filter using the frequency sampling method. Choose the order of the 
filter appropriately so that there is one sample in the transition band. Use optimum value 
for this sample. The specifications are as follows: 


lower stopband edge = 0.37 


upper stopband edge = 0.77 \ As = 40 dB 
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FIGURE P7.1 Filter Specifications for Problem P7.27 


lower passband edge = 0.47 


upper passband edge = 0.67 \ fp oa 


Provide a plot of the log-magnitude response in dB and stem plot of the impulse response. 


P7.29 The frequency response of an ideal bandpass filter is given by 


(0, 0 <ul < #/3 
Halet) = 4 1, 2/3 < |w| < 27/3 
0, 27/3 <|wl < r 


1. Determine the coefficients of a 25-tap filter based on the Parks-McClellan algorithm 
with stopband attenuation of 50 dB. The designed filter should have the smallest 
possible transition width. 

2. Plot the amplitude response of the filter using the function developed in Problem P7.6. 


P7.30 Consider the bandstop filter given in Problem P7.10. 


1. Design a linear-phase bandstop FIR filter using the Parks-McClellan algorithm. Note 
that the length of the filter must be odd. Provide a plot of the impulse response and the 
magnitude response in dB of the designed filter. 

2. Plot the amplitude response of the designed filter and count the total number of extrema 

in stopband and passbands. Verify this number with the theoretical estimate of the total 

number of extrema. 

Compare the order of this filter with those of the filters in Problems P7.10 and P7.24. 

4. Verify the operation of the designed filter on the following signal 


iad 


x(n) = 5 —5c0s (T2); 0 < n < 300 
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P7.31 Using the Parks-McClellan algorithm, design a 25-tap FIR differentiator with slope equal to 
1 sample/cycle. 


1. Choose the frequency band of interest between 0.17 and 0.97. Plot the impulse response 
and the amplitude response. 
2. Generate 100 samples of the sinusoid 


x(n) = 3sin(0.25rn), n=0,...,100 


and process through the preceding FIR differentiator. Compare the result with the 
theoretical “derivative” of x(n). Note: Don’t forget to take the 12-sample delay of the 
FIR filter into account. 


P7.32 Design a lowest-order equiripple linear-phase FIR filter to satisfy the specifications given in 
Figure P7.2. Provide a plot of the amplitude response and a plot of the impulse response. 


P7.33 A digital signal x(n) contains a sinusoid of frequency 7/2 and a Gaussian noise w(n) of zero 
mean and unit variance; i.e., 


x(n) = 2cos T + w(n) 


We want to filter out the noise component using a 50th-order causal and linear-phase FIR 
filter. 


1. Using the Parks-McClellan algorithm, design a narrow bandpass filter with passband 
width of no more than 0.027 and stopband attenuation of at least 30 dB. Note that no 
other parameters are given and that you have to choose the remaining parameters for 
the firpm function to satisfy the requirements. Provide a plot of the log-magnitude 
response in dB of the designed filter. 

2. Generate 200 samples of the sequence x(n) and processed through the preceding filter to 
obtain the output y(n). Provide subplots of x(n) and y(n) for 100 < n < 200 on one plot 
and comment on your results. 


Band 2 


0.90 +----------------------- 


Band 1 


Amplitude Response 


Band 3 


0 0.4 0.5 07 08 1 
Frequency œ in n Units 


FIGURE P7.2 Filter Specifications for Problem P7.32 
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Problems 


P7.34 Design a minimum order linear-phase FIR filter, using the Parks-McClellan algorithm, to 
satisfy the requirements given in Figure P7.1. 


1. Provide a plot of the amplitude response with grid-lines and axis labeling as shown in 


Figure P7.1. 
2. Generate the following signals 


x1(n) = cos(0.25mn), x2(n) = cos(0.57n), x3(n) = cos(0.75an); O<n< 100. 


Process these signals through this filter to obtain the corresponding output signals 
yi(n), y2(n), and y3(n). Provide stem plots of all input and output signals in one figure. 


P7.35 Design a minimum-order linear-phase FIR filter, using the Parks-McClellan algorithm, to 
satisfy the requirements given in Figure P7.3. Provide a plot of the amplitude response with 
grid-lines and axis labeling as shown in Figure P7.3. 


P7.36 The specifications on the amplitude response of an FIR filter are given in Figure P7.4. 


1. Using a window design approach and a fixed window function, design a minimum-length 
linear-phase FIR filter to satisfy the given requirements. Provide a plot of the amplitude 
response with grid-lines as shown in Figure P7.4. 

2. Using a window design approach and the Kaiser window function, design a 
minimum-length linear-phase FIR filter to satisfy the given requirements. Provide a plot 
of the amplitude response with grid-lines as shown in Figure P7.4. 

3. Using a frequency-sampling design approach and with no more than two samples in the 
transition bands, design a minimum-length linear-phase FIR filter to satisfy the given 
requirements. Provide a plot of the amplitude response with grid-lines as shown in 
Figure P7.4. 

4. Using the Parks-McClellan design approach, design a minimum-length linear-phase FIR 
filter to satisfy the given requirements. Provide a plot of the amplitude response with 
grid-lines as shown in Figure P7.4. 


Hr(@) (Not to Scale) 


0 0.20.25 0.45 0.55 0.70.75 1 


FIGURE P7.3 Filter Specifications for Problem P7.35 
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als 


0 0.2 0.5 0.7 
FIGURE P7.4 Filter Specifications for Problem P7.36 


5. Compare the preceding four design methods in terms of 
e the order of the filter 
e the exact band-edge frequencies 
e the exact tolerances in each band 
P7.37 Design a minimum-order linear-phase FIR filter, using the Parks-McClellan algorithm, to 


satisfy the requirements given in Figure P7.5. Provide a plot of the amplitude response with 
grid-lines as shown in Figure P7.5. 


als 


0 0.3 0.55 0.75 
FIGURE P7.5 Filter Specifications for Problem P7.37 
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P7.38 Design a minimum-length linear-phase bandpass filter of Problem P7.9 using the 
Parks-McClellan algorithm. 


1. Plot the impulse response and the magnitude response in dB of the designed filter in one 
figure plot. 

2. Plot the amplitude response of the designed filter and count the total number of extrema 
in passband and stopbands. Verify this number with the theoretical estimate of the total 
number of extrema. 

3. Compare the order of this filter with that of the filter in Problem P7.9. 
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CHAPTER 


IIR Filter 
Design 


IIR filters have infinite-duration impulse responses, hence they can be 
matched to analog filters, all of which generally have infinitely long im- 
pulse responses. Therefore the basic technique of IIR filter design trans- 
forms well-known analog filters into digital filters using complex-valued 
mappings. The advantage of this technique lies in the fact that both 
analog filter design (AFD) tables and the mappings are available exten- 
sively in the literature. This basic technique is called the A/D (analog- 
to-digital) filter transformation. However, the AFD tables are available 
only for lowpass filters. We also want to design other frequency-selective 
filters (highpass, bandpass, bandstop, etc.). To do this, we need to apply 
frequency-band transformations to lowpass filters. These transformations 
are also complex-valued mappings, and they are also available in the liter- 
ature. There are two approaches to this basic technique of IIR filter design: 


Approach 1: 
Design analog Apply-tea: pend Apply eis Desired IIR 
— >| transformation |—> | transformation | —> 
lowpass filter filter 
s>s s>z 
Approach 2: 
Design analog Appi ae PPP Red. pond Desired IIR 
— | transformation | —>| transformation |—> 
lowpass filter filter 
s>z Zz 
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The first approach is used in MATLAB to design IIR filters. A 
straightforward use of these MATLAB functions does not provide any 
insight into the design methodology. Therefore we will study the second 
approach because it involves the frequency-band transformation in the 
digital domain. Hence in this IIR filter design technique we will follow 
the following steps: 


e Design analog lowpass filters. 

e Study and apply filter transformations to obtain digital lowpass filters. 

e Study and apply frequency-band transformations to obtain other digi- 
tal filters from digital lowpass filters. 


The main problem with these approaches is that we have no control 
over the phase characteristics of the IIR filter. Hence IIR filter designs 
will be treated as magnitude-only designs. More sophisticated techniques, 
which can simultaneously approximate both the magnitude and the phase 
responses, require advanced optimization tools and hence will not be cov- 
ered in this book. 

We begin with a discussion on the analog filter specifications and the 
properties of the magnitude-squared response used in specifying analog 
filters. Next, before we delve into basic techniques for general IIR filters, 
we consider the design of special types of digital filters—for example, 
resonators, notch filters, comb filters, etc. This is followed by a brief de- 
scription of the characteristics of three widely used analog filters: namely. 
Butterworth, Chebyshev, and elliptic filters. Finally, we will study transfor- 
mations to convert these prototype analog filters into different frequency- 
selective digital filters and conclude this chapter with several IIR filter 
designs using MATLAB. 


8.1 SOME PRELIMINARIES 
—— a 


We discuss two preliminary issues in this section. First, we consider the 
magnitude-squared response specifications, which are more typical of ana- 
log (and hence of IIR) filters. These specifications are given on the relative 
linear scale. Second, we study the properties of the magnitude-squared 
response. 


8.1.1 RELATIVE LINEAR SCALE 
Let Ha(jQ) be the frequency response of an analog filter. Then the lowpass 
filter specifications on the magnitude-squared response are given by 


1 <|HGQP< 1, <A 
1+é? i P (8.1) 


0 < |Ha (jQ)? < Fa, Os < || 
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1+ 


0 l l -9 
0 Qp Qs 


FIGURE 8.1 Analog lowpass filter specifications 


where € is a passband ripple parameter, Q, is the passband cutoff fre- 
quency in rad/sec, A is a stopband attenuation parameter, and ©, is the 
stopband cutoff in rad/sec. These specifications are shown in Figure 8.1, 
from which we observe that |H(jQ)|? must satisfy 


1 


|Ha)? = — at =Q, 
1 +e 
(8.2) 
1 
|Ha(GQs)|? > Az at N= Qs 


The parameters € and A are related to parameters Rp and As, respec- 
tively, of the dB scale. These relations are given by 


1 
Rp = —10 log Tle => 6 = V 10%p/10 — 1 (8.3) 


and 
1 
As = -1010810 Ga = A= 104s/20 (8.4) 


The ripples, 6; and 69, of the absolute scale are related to € and A by 
1-6 
tft iy Bes 2/6, 
1+ 6; 1+ e 1-6, 


1 
14+ 6, a7 69 


and 
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8.1.2 PROPERTIES OF |Ha (jQ)? 

Analog filter specifications (8.1), which are given in terms of the 
magnitude-squared response, contain no phase information. Now to eval- 
uate the s-domain system function H,(s), consider 


Aa(GQ) = Ha(s)|,=j0 
Then we have 
|Ha(jQ)|? = Ha(GQ) HE (JQ) = Ha(jO)Ha(—jQ) = Ha(s)Ha(—s)| 


or 


H,(8)Ha(—s) = |Ha (jN)? ra! (8.5) 


Therefore the poles and zeros of the magnitude-squared function are dis- 
tributed in a mirror-image symmetry with respect to the jQ axis. Also for 
real filters, poles and zeros occur in complex conjugate pairs (or mirror- 
image symmetry with respect to the real axis). A typical pole-zero pat- 
tern of Ha(s)Ha(—s) is shown in Figure 8.2. From this pattern we can 
construct Ha(s), which is the system function of our analog filter. We 
want H,(s) to represent a causal and stable filter. Then all poles of Ha(s) 
must lie within the left half-plane. Thus we assign all left-half poles of 
H,(s)Ha(—s) to Ha(s). However, zeros of H,(s) can lie anywhere in the 
s-plane. Therefore they are not uniquely determined unless they all are 
on the jQ axis. We will choose the zeros of H,(s)H,(—s) lying left to or 
on the jQ axis as the zeros of Ha(s). The resulting filter is then called a 
minimum-phase filter. 


ja 
A 
© 
oO o s-plane 
x x 
S) x x O—> o 
x X 
O O 
© 


FIGURE 8.2 Typical pole-zero pattern of Ha(s)Ha(—s) 
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8.2 SOME SPECIAL FILTER TYPES 
EE 


In this section we consider the design of several special types of digital 
filters and describe their frequency response characteristics. We begin by 
describing the design and characteristics of a digital resonator. 


8.2.1 DIGITAL RESONATORS 
A digital resonator is a special two-pole bandpass filter with a pair of 
complex-conjugate poles located very near the unit circle, as shown in 
Figure 8.3a. The magnitude of the frequency response of the filter is shown 
in Figure 8.3b. The name resonator refers to the fact that the filter has a 
large magnitude response in the vicinity of the pole position. The angle of 
the pole location determines the resonant frequency of the filter. Digital 
resonators are useful in many applications, including simple bandpass 
filtering and speech generation. 

Let us consider the design of a digital resonator with a resonant peak 
at or near w = wọ. Hence, we select the pole position as 


pi,2 = rew io (8.6) 


Digital Resonator Responeses 


Pole—zero Plot Magnitude Response 
1 . 7 o | ' i 
: ne) 
0.8 x: 2 E | | 
/ ae | | 
0.6 D 
= f F o2 | | 
R 0.4 HY | = : | 
> 0.27 - is ea -1 -1/3 0 1/3 1 
© Obese ened Se £ E E E E 
5-02 oN | - Penase Response 
E -0.4 a i 
\ Yn 
-0.6 \ S 0 
-0.8 x. 5 
Be v 
“4 oc 
-0.5 
-1 -0.5 0 0.5 1 z -1/3 0 1/3 1 
Real Part o in m units 


FIGURE 8.3 Pole positions and frequency response of a digital resonator with 
r = 0.9 and wo = 17/3 
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The corresponding system function is 
bo 
(1 — revo z-1)(1 — re~J¥oz—1) 
b 


1 — (2rcoswo)z7! + r2z-2 


H(z) = 


where bg is a gain parameter. The frequency response of the resonator is 


ae bo 
H(e? ) F [1 = re—j(w—wo)] [1 aa re—i(w+wo)] (8.8) 


Since |H (e%) | has its peak at or near w = wo, we select the gain param- 
eter bo so that |H(e!”)| = 1. Hence, 


bo 
H(e?”°)| = : 
ON = a re 
bo 
= 8.9 
(1 —r)V/1 + r? — 2r cos 2wo eo) 
Consequently, the desired gain parameter is 
bo = (1 - r)V1 + r? — 2r cos 2wo (8.10) 


The magnitude of the frequency response H (w) may be expressed as 


|H(e3*)| = PAOTR (8.11) 

where Dı(w) and Do(w) are given as 
Dy(w) = y1 +r? — 2r cos(w — wo) (8.12a) 
Do(w) = y1 +r? — 2r cos(w + wo) (8.12b) 


For a given value of r, Dı(w) takes its minimum value (1 — r) at w = wo, 
and the product Dı(w)D2(w) attains a minimum at the frequency 


2 
Ww, = cost (+ ae cos wo) (8.13) 
2r 


which defines precisely the resonant frequency of the filter. Note that 
when r is very close to unity, wr œ% wo, which is the angular position of 
the pole. Furthermore, as r approaches unity, the resonant peak becomes 
sharper (narrower) because D,(w) changes rapidly in the vicinity of wọ. 
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A quantitative measure of the width of the peak is the 3dB bandwidth of 
the filter, denoted as A(w). For values of r close to unity, 


Aw x 2(1—r) (8.14) 


Figure 8.3 illustrates the magnitude and phase responses of a digital res- 
onator with wo = 7/3, r = 0.90. Note that the phase response has its 
greatest rate of change near the resonant frequency wr © wo = 77/3. 

This resonator has two zeros at z = 0. Instead of placing zeros at the 
origin, an alternative choice is to locate the zeros at z = 1 and z = —1. 
This choice completely eliminates the response of the filter at the frequen- 
cies w = 0 and w = 7, which may be desirable in some applications. The 
corresponding resonator has the system function 


G(1 — 271)\(1+ 271) 


H(z) = , 
(2) (1 — revo z-1)(1 — re~J0z—1) 


_ 4-2 
zg s= (8.15) 


1 — (2rcoswo)z7! + r2z72 


and the frequency response characteristic 


F= e Jaw 


(8.16) 


Jw) — 
He) = Ca — rej(vo-)]/1 — re~i(wot)] 


where G is a gain parameter that is selected so that |H (ei) | =i 


The introduction of zeros at z = +1 alters both the magnitude and 
phase response of the resonator. The magnitude response may be ex- 
pressed as 

i N(w) 
H(e*)| = G 8.17 
#(e™)| = Gay Datw) (8.17) 


where N(w) is defined as 


N(w) = \/2(1 = cos Qw) (8.18) 


Due to the presence of the zeros at z = +1, the resonant frequency of the 
resonator is altered from the expression given by (8.13). The bandwidth 
of the filter is also altered. Although exact values for these two parameters 
are rather tedious to derive, we can easily compute the frequency response 


when the zeros are at z = +1 and z = 0, and compare the results. 
Figure 8.4 illustrates the magnitude and phase responses for the cases 
z = +1 and z = 0, for pole location at w = 7/3 and r = 0.90. We observe 


that the resonator with z = +1 has a slightly smaller bandwidth than 
the resonator with zeros at z = 0. In addition, there appears to be a very 
small shift in the resonant frequency between the two cases. 
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Magnitude Response 
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FIGURE 8.4 Magnitude and phase responses of digital resonator with zeros at 
z = +1 (solid lines) and z = 0 (dotted lines) for r = 0.9 and wo = 17/3 


8.2.2 NOTCH FILTERS 
A notch filter is a filter that contains one or more deep notches or, ideally, 
perfect nulls in its frequency response. Figure 8.5 illustrates the frequency 
response of a notch filter with a null at the frequency w = wo. Notch filters 
are useful in many applications where specific frequency components must 
be eliminated. For example, instrumentation systems require that the 
power line frequency of 60 Hz and its harmonics be eliminated. 

To create a null in the frequency response of a filter at a frequency 
wo, we simply introduce a pair of complex-conjugate zeros on the unit 
circle at the angle wo. Hence, the zeros are selected as 


Zig Se (8.19) 
Then, the system function for the notch filter is 
H(z) = bo(1 — ef% 271) (1 — e 9271) 
= bo(1 — (2 coswo)z7* + 27°?) (8.20) 


where bo is a gain factor. Figure 8.6 illustrates the magnitude response of 
a notch filter having a null at w = 7/4. 

The major problem with this notch filter is that the notch has a rela- 
tively large bandwidth, which means that other frequency components 
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Pole—zero Plot 


Magnitude Response 
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FIGURE 8.5 Frequency response of a typical notch filter 
around the desired null are severely attenuated. To reduce the band- 
width of the null, we may resort to the more sophisticated, longer FIR 
filter designed according to the optimum equiripple design method de- 
scribed in Chapter 7. Alternatively, we could attempt to improve the fre- 
quency response of the filter by introducing poles in the system function. 
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FIGURE 8.6 Frequency response of a notch filter with wo = 1/4 
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Pole—zero Plot Magnitude Response 
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FIGURE 8.7 Magnitude and phase responses of notch filter with poles (solid 
lines) and without poles (dotted lines) for wo = 1/4 and r = 0.85 


In particular, suppose that we select the poles at 


pi,2 = rerio (8.21) 
Hence, the system function becomes 


1 — (2coswp)z71 + 2? 


H(z)=b 
(2) ° 1 — (2r coswo)z—! + r22-2 


(8.22) 


The magnitude of the frequency response |H (e%)| of this filter is illus- 
trated in Figure 8.7 for wo = 7/4 and r = 0.85. Also plotted in this figure 
is the frequency response without the poles. We observe that the effect of 
the pole is to introduce a resonance in the vicinity of the null and, thus, to 
reduce the bandwidth of the notch. In addition to reducing the bandwidth 
of the notch, the introduction of a pole in the vicinity of the null may re- 
sult in a small ripple in the passband of the filter due to the resonance 
created by the pole. 


8.2.3 COMB FILTERS 

In its simplest form, a comb filter may be viewed as a notch filter in which 
the nulls occur periodically across the frequency band, hence the analogy 
to an ordinary comb that has periodically spaced teeth. Comb filters are 
used in many practical systems, including the rejections of power-line 
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harmonics, and the suppression of clutter from fixed objects in moving- 
target indicator (MTI) radars. 

We can create a comb filter by taking our FIR filter with system 
function 


M 
HQ > hee (8.23) 
k=0 


and replacing z by 2”, where L is a positive integer. Thus, the new FIR 
filter has the system function 


H(z) = X h(k)? (8.24) 


k=0 


If the frequency response of the original FIR filter is H (ei oy, the frequency 
response of the filter given by (8.24) is 


M 
Hye) = X. hte tt = H (et) (8.25) 


Consequently, the frequency response characteristic H glei a) is an L-order 
repetition of H(e!”) in the range 0 < w < 27. Figure 8.8 illustrates the 
relationship between H7(e!”) and H(e!*) for L = 4. The introduction of 
a pole at each notch may be used to narrow the bandwidth of each notch, 
as just described. 


8.2.4 ALLPASS FILTERS 
An allpass filter is characterized by a system function that has a constant 
magnitude response for all frequencies, i.e., 


| H(e%”) | =1, O<w<nt (8.26) 


A simple example of an allpass system is a system that introduces a pure 
delay to an input signal, i.e., 


H(z) =z" (8.27) 


This system passes all frequency components of an input signal without 
any frequency dependent attenuation. It simply delays all frequency com- 
ponents by k samples. 

A more general characterization of an allpass filter is one having a 
system function of the form 


an +an-1277! +: + az 


~ 1+az t+- +ayniz Nt Hayz N 


N+1 a zN 


A(z) 


(8.28) 
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FIGURE 8.8 Comb filters with frequency response Hr(et®) obtained from 
H(e7”) for L=4 


which may be expressed in the compact form as 


NA) 
-N 
H(z)=z AG) (8.29) 
where 
N 
Alz)= X az", asl (8.30) 
k=0 
We observe that 
|H(e) |? = HH) = 1 (8.31) 


for all frequencies. Hence, the system is all-pass. 

From the form of H(z) given by (8.28), we observe that if zo is a pole 
of H(z), then 1/zp is a zero of H(z). That is, the poles and zeros are 
reciprocals of one another. Figure 8.9 illustrates the typical pole-zero pat- 
tern for a single-pole, single-zero filter and a 2-pole, 2-zero filter. Graphs 
of the magnitude and phase characteristics of these two filters are shown 
in Figure 8.10 for a = 0.6 and r = 0.9, wo = 7/4, where A(z) for the two 
filters is, respectively, given as 


A(z) =1+.a27* (8.32a) 
A(z) = 1 — (2rcoswo)z71 + r?z7? (8.32b) 
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FIGURE 8.9 Pole-zero locations for (a) one-pole and (b) two-pole allpass filter 


The general form for the system function of an allpass filter with real 
coefficients may be expressed in factored form as 


Nr N: 


oppeto py (A e pk) 
no=U iaa lla aaan E 


where Np is the number of real poles and zeros and Nc is the number 
of complex-conjugate pairs of poles and zeros. For a causal and stable 
system, we require that |a;| < 1 and |6ķ| < 1. 

Allpass filters are usually employed as phase equalizers. When placed 
in cascade with a system that has an undesirable phase response, a phase 
equalizer is designed to compensate for the poor phase characteristics of 
the system and thus result in an overall linear phase system. 


8.2.5 DIGITAL SINUSOIDAL OSCILLATORS 
A digital sinusoidal oscillator can be viewed as a limiting form of a 2-pole 
resonator for which the complex-conjugate poles are located on the unit 


Magnitude Response Phase Response 
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FIGURE 8.10 Magnitude and phase responses for 1-pole (solid line) and 2-pole 
(dotted line) allpass filters 
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circle. From our previous discussion of resonators, the system function for 
a resonator with poles at re+/”° is 


ne 1 — (2r cos a + 722-2 Gea) 
When we set r = 1 and select the gain parameter bo as 
bo = Asin wo (8.35) 
The system function becomes 
Asinw 
ANE 1 — (2cos ae +272 38) 
and the corresponding impulse response of the system becomes 
h(n) = Asin(n + 1)wo u(n) (8.37) 


Thus, this system generates a sinusoidal signal of frequency wo when ex- 
cited by an impulse 6(n) = 1. 

The block diagram representation of the system function given by 
(8.36) is illustrated in Figure 8.11. The corresponding difference equation 
for this system is 


y(n) = (2 coswo) y(n — 1) — y(n — 2) + bo d(n) (8.38) 


where bọ = Asin wọ. 

Note that the sinusoidal oscillation obtained from the difference equa- 
tion in (8.38) can also be obtained by setting the input to zero and setting 
the initial conditions to y(—1) = 0, y(—2) = —Asin wọ. Thus, the zero- 
input response to the 2nd-order system described by the homogeneous 
difference equation 


y(n) = (2coswo) y(n — 1) — y(n — 2) (8.39) 


Asin(@)d6(n) y(n) = Asin[(n + 1)wo]u() 


z cos(wo) 


FIGURE 8.11 Digital sinusoidal oscillator 
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with initial conditions y(—1) = 0, y(—2) = —Asinwp is exactly the same 
as the response of (8.38) to an impulse excitation. In fact, the homo- 
geneous difference equation in (8.39) can be obtained directly from the 
trigonometric identity 


sina + sin 8 = 2sin (=) cos (=£) (8.40) 


where, by definition, a = (n + 1)wo, 8 = (n — 1)wo, and y(n) = sin(n + 
1)wo. 

In practical applications involving modulation of two sinusoidal car- 
rier signals in phase quadrature, there is a need to generate the sinusoids 
Asinwon and Acoswon. These quadrature carrier signals can be gener- 
ated by the so-called coupled-form oscillator, which can be obtained with 
the aid of the trigonometric formulas 


cos(a + 8) = cosa cos 8 — sin a sin 8 (8.41) 


sin(a + 8) = sin a cos 8 + cos a sin 3 (8.42) 


where by definition, a = nwo, B = wo, Ye(n) = cos(n + 1)wo, and ys(n) = 
sin(n + 1)wo. Thus, with substitution of these quantities into the two 
trigonometric identities, we obtain the two coupled difference equations. 


Ye(n) = (cos wo) ye(n — 1) — (sin wo) ys(n — 1) (8.43) 
ys(n) = (sinwo) ye(n — 1) + (coswo) ys(n — 1) (8.44) 


The structure for the realization of the coupled-form oscillator is il- 
lustrated in Figure 8.12. Note that this is a 2-output system that does 
not require any input excitation, but it does require setting the initial 
conditions ye(—1) = Acoswo and ys(—1) = —Asinwo in order to begin 
its self-sustaining oscillations. 


8.3 CHARACTERISTICS OF PROTOTYPE ANALOG FILTERS 
—— g 


IIR filter design techniques rely on existing analog filters to obtain digital 
filters. We designate these analog filters as prototype filters. Three pro- 
totypes are widely used in practice. In this section we briefly summarize 
the characteristics of the lowpass versions of these prototypes: Butter- 
worth lowpass, Chebyshev lowpass (Type I and II), and Elliptic lowpass. 
Although we will use MATLAB functions to design these filters, it is nec- 
essary to learn the characteristics of these filters so that we can use proper 
parameters in MATLAB functions to obtain correct results. 
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Ye(n) 


ys(n) 


FIGURE 8.12 Realization of the coupled form oscillator 


8.3.1 BUTTERWORTH LOWPASS FILTERS 

This filter is characterized by the property that its magnitude response is 
flat in both passband and stopband. The magnitude-squared response of 
an Nth-order lowpass filter is given by 


AC ee (8.45) 


Q\2" 
1 ca 
(a) 


where N is the order of the filter and Qe is the cutoff frequency in rad/sec. 
The plot of the magnitude-squared response is as follow. 


|H,(jQ)| N=% 
A 
1.0 


0.5 


From this plot, we can observe the following properties: 


e at 2=0, |Ha(j0)|? = 1 for all N. 

© at Q= Qe, |Ha(jQ-)|? = 4 for all N, which implies a 3 dB attenuation 
at Qe. 

e |H,(jQ)|° is a monotonically decreasing function of Q. 
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e |Ha (jQ)|? approaches an ideal lowpass filter as N — oo. 
© |Ha (jQ)|? is maximally flat at Q = 0 since derivatives of all orders exist 
and are equal to zero. 


To determine the system function H,(s), we put (8.45) in the form of 
(8.5) to obtain 


goa PD = 1 GSE 
Halil) = HELIO, = — cays sua 
JQe 
(8.46) 


The roots of the denominator polynomial (or poles of H,(s)H,(—s)) from 
(8.46) are given by 


De = (—1)2" (JQ) = Noei 2AtN+Y) = =0,1,...,2N—1 (8.47) 
An interpretation of (8.47) is that 


e there are 2N poles of Ha(s)Ha(—s), which are equally distributed on 
a circle of radius Qe with angular spacing of 7/N radians 
e for N odd the poles are given by pp = Q.e"7/%, k=0,1,...,2N—1 
e for N even the poles are given by pk = Qe ee +4), k=0,1,..., 
2N-1 
the poles are symmetrically located with respect to the jQ axis 
a pole never falls on the imaginary axis, and falls on the real axis only 
if N is odd 


As an example, poles of 3rd- and 4th-order Butterworth filters are shown 
in Figure 8.13. 


jQ jQ 
A A 
PK get ee 
7 % 7 Q. 7 
\ 
\ pe 1 
x 0 kao > Oo : 7 l >= 0 
\ f , r 
/ 
S F N „/k=2N-1 
`X] -Xk=2N-1 `x | <7 
N=3 N=4 


FIGURE 8.13 Pole plots for Butterworth filters 
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FIGURE 8.14 Pole plot for Example 8.1 


A stable and causal filter H,(s) can now be specified by selecting 
poles in the left half-plane, and H,(s) can be written in the form 


QN 
H,(s) = c (8.48) 
° JI (s- p) 
LHP poles 
EXAMPLE 8.1 Given that |Ha (jN)|? = r determine the analog filter system function 
Ha(s). 
Solution From the given magnitude-squared response, 
1 1 
Ha (jQ)? = = 
|Ha) = T ea 


Q 2(3) 
t Ge 


Comparing this with expression (8.45), we obtain N = 3 and Q. = 0.5. The 
poles of H,(s)Ha(—s) are as shown in Figure 8.14. 
Hence 
Q3 
(s — p2)(s — p3) (s — pa) 
1/8 
(s +0.25 — j0.433)(s + 0.5)(s + 0.25 + j0.433) 


Ha (j9) = 


0.125 
(s + 0.5)(s? + 0.58 + 0.25) 


8.3.2 MATLAB IMPLEMENTATION 
MATLAB provides a function called [z,p,k]=buttap(N) to design a nor- 
malized (i.e., Qe = 1) Butterworth analog prototype filter of order N, 
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which returns zeros in z array, poles in p array, and the gain value k. 
However, we need an unnormalized Butterworth filter with arbitrary Qe. 
From Example 8.1 we observe that there are no zeros and that the poles 
of the unnormalized filter are on a circle with radius Qe instead of on a 
unit circle. This means that we have to scale the array p of the normal- 
ized filter by Qe and the gain k by QN. In the following function, called 
U_buttap(N,Omegac), we design the unnormalized Butterworth analog 
prototype filter. 


function [b,a] = u_buttap(N,Omegac) ; 
% Unnormalized Butterworth Analog Lowpass Filter Prototype 


E ee SO ee LED SA Oi ener oe EN 
% [b,a] = u_buttap(N,Omegac) ; 
% b = numerator polynomial coefficients of Ha(s) 
tb a = denominator polynomial coefficients of Ha(s) 
h N = Order of the Butterworth Filter 
% Omegac = Cutoff frequency in radians/sec 
hh 
[z,p,k] = buttap(N) ; 

p = p*Omegac; 

k = k*0megac^N; 

B = real(poly(z)); 


bO = k; b = k*B; a = real(poly(p)); 


This function provides a direct form (or numerator-denominator) struc- 
ture. Often we also need a cascade form structure. In Chapter 6 we have 
already studied how to convert a direct form into a cascade form. The 
following sdir2cas function describes the procedure that is suitable for 
analog filters. 


function [C,B,A] = sdir2cas(b,a); 
% DIRECT-form to CASCADE-form conversion in s-plane 


% (C,B,A] = sdir2cas(b,a) 


% C = gain coefficient 

% B= K by 3 matrix of real coefficients containing bk’s 
% A= K by 3 matrix of real coefficients containing ak’s 
% b = numerator polynomial coefficients of DIRECT form 

% a = denominator polynomial coefficients of DIRECT form 
% 


Na = length(a)-1; Nb = length(b)-1; 
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% compute gain coefficient C 
bO = b(1); b = b/bO; a0 = a(1); a = a/a0; C = b0/a0; 
h 
% Denominator second-order sections: 
p= cplxpair(roots(a)); K = floor(Na/2) ; 
if K*2 == Na % Computation when Na is even 
A = zeros(K,3); 
for n=1:2:Na 
Arow = p(n:1:n+1,:); Arow = poly(Arow) ; 
A(f£ix((n+1)/2),:) = real(Arow) ; 
end 


elseif Na == % Computation when Na = 1 
A = [0 real(poly(p))]; 


else % Computation when Na is odd and > 1 
A = zeros(K+1,3); 
for n=1:2:2*K 
Arow = p(n:1:n+1,:); Arow = poly(Arow) ; 
A(f£ix((nt+1)/2),:) = real(Arow) ; 
end 
A(K+1,:) = [0 real(poly(p(Na)))]; 
end 


% Numerator second-order sections: 

z = cplxpair(roots(b)); K = floor(Nb/2) ; 

if Nb == % Computation when Nb = 0 
B = [0 0 poly(z)]; 


elseif K*2 == Nb % Computation when Nb is even 
B = zeros(K,3); 
for n=1:2:Nb 
Brow = z(n:1:nt1,:); Brow = poly(Brow) ; 
B(fix((n+1)/2),:) = real(Brow); 
end 


elseif Nb == % Computation when Nb = 1 
B = [0 real(poly(z))]; 


else % Computation when Nb is odd and > 1 
B = zeros(K+1,3); 
for n=1:2:2*K 
Brow = z(n:1:nt1,:); Brow = poly(Brow) ; 
B(fix((n+1)/2),:) = real(Brow); 
end 
B(K+1,:) = [0 real(poly(z(Nb)))]; 
end 
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EXAMPLE 8.2 Design a 3rd-order Butterworth analog prototype filter with Q. = 0.5 given in 
Example 8.1. 


Solution MATLAB script: 


>> N = 3; OmegaC = 0.5; [b,a] = u_buttap(N,OmegaC) ; 
>> [C,B,A] = sdir2cas(b,a) 


C = 0.1250 
B=0 (0) 1 
A = 1.0000 0.5000 0.2500 


0 1.0000 0.5000 


The cascade form coefficients agree with those in Example 8.1. 


8.3.3 DESIGN EQUATIONS 

The analog lowpass filter is specified by the parameters Qp, Rp, Qs, and 
A,. Therefore the essence of the design in the case of Butterworth filter 
is to obtain the order N and the cutoff frequency Qe, given these specifi- 
cations. We want 


e at Q = Qp, —10 logio |Ha(jQ)|? = Rp or 


1 
~10log,, | —— p | =. 


Q 2N 
1 eae 
+ (#) 
and 


e at Q= Qs, —10 logio |Ha(jQ)|? = As or 


1 
Sd | —— y | = 4; 


Q.N 2N 
1 ar 
+ (az) 


Solving these two equations for N and Qe, we have 


y — 10810 [(1072/10 — 1) / (104/10 — 1)] 
= 2lo8g10 (Qp/Qs) 


In general, N will not be an integer. Since we want N to be an integer, 
we must choose 


| logio [102 — 1) / (104° — 1)] 


N 
2log10 (Qp/Qs) 


(8.49) 
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where the operation [2] means “choose the smallest integer larger than 
x” —for example, [4.5] =5. Since the actual N chosen is larger than re- 
quired, specifications can be either met or exceeded either at Q, or at Qs. 
To satisfy the specifications exactly at Qp, 


Q= Op (8.50) 
2N (1022/10 a 1) 


or, to satisfy the specifications exactly at Qs, 


me Os (8.51) 


2N (1042/10 = 1) 


EXAMPLE 8.3 Design a lowpass Butterworth filter to satisfy 


Passband cutoff: Q, = 0.27 ; Passband ripple: Rp = 7dB 
Stopband cutoff: Qs = 0.37 ; Stopband ripple: As = 16dB 


Solution From (8.49) 


_ J tose [007 -1700 -)]] _ 


N 
2 logy, (0.27/0.37) 


[2.79] =3 


To satisfy the specifications exactly at Qp, from (8.50) we obtain 


Q= gan = 0.4985 


6 /(10°7 = 1) 


To satisfy specifications exactly at Qs, from (8.51) we obtain 


Q = 0.37 = 0.5122 


6 (101.6 = 1) 


Now we can choose any Qe between the above two numbers. Let us choose 
Qe = 0.5. We have to design a Butterworth filter with N = 3 and Qe. = 0.5, 
which we did in Example 8.1. Hence 


0.125 
(s + 0.5) (s? + 0.58 + 0.25) 


Aa (GQ) = 
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8.3.4 MATLAB IMPLEMENTATION 

The preceding design procedure can be implemented in MATLAB as a 
simple function. Using the U_buttap function, we provide the afd_butt 
function to design an analog Butterworth lowpass filter, given its specifi- 
cations. This function uses (8.50). 


function [b,a] = afd_butt(Wp,Ws,Rp,As) ; 
% Analog Lowpass Filter Design: Butterworth 


% [b,a] = afd_butt(Wp,Ws,Rp, As) ; 

% b = Numerator coefficients of Ha(s) 

% a = Denominator coefficients of Ha(s) 

% Wp = Passband edge frequency in rad/sec; Wp > 0 

% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 


% Rp = Passband ripple in +dB; (Rp > 0) 
% As = Stopband attenuation in +dB; (As > 0) 
h 
if Wp <= 0 
error(’Passband edge must be larger than 0’) 
end 
if Ws <= Wp 
error (’Stopband edge must be larger than Passband edge’) 
end 


if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


N = ceil ((1o0g10((107 (Rp/10)-1) /(107 (As/10)-1) ))/(2*10g10 (Wp/Ws) )) ; 
fprintf(’\n*** Butterworth Filter Order = %2.0f \n’,N) 

OmegaC = Wp/((107 (Rp/10)-1)~ (1/(2*N))); 

[b,a]=u_buttap(N,OmegaC) ; 


To display the frequency-domain plots of analog filters, we provide a 
function called freqs_m, which is a modified version of a function freqs 
provided by MATLAB. This function computes the magnitude response 
in absolute as well as in relative dB scale and the phase response. This 
function is similar to the freqz_m function discussed earlier. One main 
difference between them is that in the freqs_m function the responses are 
computed up to a maximum frequency Nmax- 


function [db,mag,pha,w] = freqs_m(b,a,wmax) ; 

% Computation of s-domain frequency response: Modified version 
VEEE 
% [db,mag,pha,w] = freqs_m(b,a,wmax) ; 
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% db = Relative magnitude in db over [0 to wmax] 
% mag = Absolute magnitude over [0 to wmax] 
% pha = Phase response in radians over [0 to wmax] 


% w = array of 500 frequency samples between [0 to wmax] 

h b = Numerator polynomial coefficents of Ha(s) 

h a = Denominator polynomial coefficents of Ha(s) 

% wmax = Maximum frequency in rad/sec over which response is desired 
% 


w = [0:1:500]*wmax/500; H = freqs(b,a,w); 


mag = abs(H); db = 20*log10((magteps)/max(mag)); pha = angle(H) ; 


The impulse response h,(t) of the analog filter is computed using 
MATLAB’s impulse function. 


EXAMPLE 8.4 Design the analog Butterworth lowpass filter specified in Example 8.3 using 
MATLAB. 


Solution MATLAB script: 


>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 7; As = 16; 
>> Ripple = 10 ~ (-Rp/20); Attn = 10 ~ (-As/20); 
>> % Analog filter design: 

>> [b,a] = afd_butt(Wp,Ws,Rp,As) ; 

*k* Butterworth Filter Order = 3 

>> % Calculation of second-order sections: 

>> [C,B,A] = sdir2cas(b,a) 


C = 0.1238 
3S © (0) 1 
A = 1.0000 0.4985 0.2485 


0 1.0000 0.4985 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 


The system function is given by 


0.1238 
(s? + 0.49855 + 0.2485) (s + 0.4985) 


H,(s) = 


This Ha(s) is slightly different from the one in Example 8.3 because in that 
example we used Q. = 0.5, while in the afd_butt function Qe is chosen to 
satisfy the specifications at Qp. The filter plots are shown in Figure 8.15. 
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FIGURE 8.15 Butterworth analog filter in Example 8.4 


8.3.5 CHEBYSHEV LOWPASS FILTERS 

There are two types of Chebyshev filters. The Chebyshev-I filters have 
equiripple response in the passband, while the Chebyshev-II filters have 
equiripple response in the stopband. Butterworth filters have monotonic 
response in both bands. Recall our discussions regarding equiripple FIR 
filters. We noted that by choosing a filter that has an equiripple rather 
than a monotonic behavior, we can obtain a lower-order filter. Therefore 
Chebyshev filters provide lower order than Butterworth filters for the 
same specifications. 

The magnitude-squared response of a Chebyshev-I filter is 


1 


Q 
1+ eT (=) 


where NV is the order of the filter, € is the passband ripple factor, which is 
related to Rp, and Ty (x) is the Nth-order Chebyshev polynomial given by 


|Ha(JQ)? = (8.52) 


cos (N cos~+ ,0<a<1 Q 
Ty(z) = ( a ata where « = — 
cosh (cosh~*(x)), 1< £ < 00 Qe 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Characteristics of Prototype Analog Filters 411 


The equiripple response of the Chebyshev filters is due to this polynomial 
Tn(x). Its key properties are (a) for 0 < x < 1, Ty(x) oscillates be- 
tween —1 and 1, and (b) for 1 < x < œ, T(x) increases monotonically 
to oo. 

There are two possible shapes of |H,(jQ)|*, one for N odd and one for 
N even as shown here. Note that x = Q/Qe is the normalized frequency. 


| 2 


N Odd 


a, 
Qe 
From these two response plots we observe the following properties: 


e Atz=O(orQ=0);  |Ha(j0)|? = 


| 
H 


for N odd. 


1 
|Ha(j0)|? = ET for N even. 


1 
e Atr=1(r9Q=29); HGD? = Tre fralN. 
€ 


e For0 < x <1 (or0<2< Qe), |Aa(jz)| oscillates between 1 and 
1 


1+ e2 


e For x> 1 (or Q > Qe), |Ha(jx)|? decreases monotonically to 0. 


At z = Q,, |Ha(jz)|? = 


e ye" 

To determine a causal and stable H,(s), we must find the poles of 
H,(s)Ha(—s) and select the left half-plane poles for H,(s). The poles of 
H,(s)Ha(—s) are obtained by finding the roots of 


14272 (= 
= * Ga.) 


The solution of this equation is tedious if not difficult to obtain. It can be 
shown that if py =o, + jk, k=0,...,N—1 are the (left half-plane) 
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roots of these polynomial, then 


E m  (2k+1)0 
Ok = (aQe) COS E + | 


T i] ne 


N-1 (8.53) 
Q, = (be) sin E + oN 


where 


a = 


(Va-VT/e), b= 5 (Va+y/1/a), and a=14y1+3 


(8.54) 


NI = 


These roots fall on an ellipse with major axis DQ, and minor axis aQe. 
Now the system function is given by 


Hals) = = (8.55) 


where K is a normalizing factor chosen to make 


I; N odd 
Ha(j0) = er (8.56) 
VIF 


8.3.6 MATLAB IMPLEMENTATION 

MATLAB provides a function called [z,p,k]=cheb1ap(N,Rp) to design 
a normalized Chebyshev-I analog prototype filter of order N and pass- 
band ripple Rp and that returns zeros in z array, poles in p array, and 
the gain value k. We need an unnormalized Chebyshev-I filter with arbi- 
trary Qe. This is achieved by scaling the array p of the normalized filter 
by Qe. Similar to the Butterworth prototype, this filter has no zeros. 
The new gain k is determined using (8.56), which is achieved by scaling 
the old k by the ratio of the unnormalized to the normalized denom- 
inator polynomials evaluated at s = 0. In the following function, called 
U_chbiap(N,Rp,Omegac), we design an unnormalized Chebyshev-I analog 
prototype filter that returns H,(s) in the direct form. 
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function [b,a] = u_chblap(N,Rp,Omegac) ; 
% Unnormalized Chebyshev-1 Analog Lowpass Filter Prototype 


% [b,a] = u_chblap(N,Rp,Omegac) ; 


h b = numerator polynomial coefficients 

hh a = denominator polynomial coefficients 

% N = Order of the Elliptic Filter 

% Rp = Passband Ripple in dB; Rp > O 

% Omegac = Cutoff frequency in radians/sec 

hh 

[z,p,k] = cheblap(N,Rp); a = real(poly(p)); aNn = a(N+1); 


p = p*Omegac; a = real(poly(p)); aNu = a(Nt1); 
k = k*aNu/aNn; 
bO = k; B = real(poly(z)); b = k*B; 


8.3.7 DESIGN EQUATIONS 
Given Qp, Qs, Rp, and Ag, three parameters are required to determine 
a Chebyshev-I filter: €, Qe, and N. From equations (8.3) and (8.4), we 


obtain 
e= y10%1REr —1 and A= 104/2 


From these properties, we have 


Qe = Qp and Q, = H (8.57) 
Np 
The order N is given by 
g = (A? - 1) /e (8.58) 


logo [9 oT VP =I 
logio [o a Jor =I 


Now using (8.54), (8.53), and (8.55), we can determine H,(s). 


(8.59) 


EXAMPLE 8.5 Design a lowpass Chebyshev-I filter to satisfy 
Passband cutoff: Q, = 0.27 ; Passband ripple: Rp = 1dB 
Stopband cutoff: Qs = 0.37 ; Stopband ripple: As = 16dB 


Solution First compute the necessary parameters. 
e = V10°1M — 1 = 0.5088 A = 1019/29 = 6.3096 
0.370 
Qe =Q, = 0.2 Qr = =1. 
ne ae 0.27 3 


g = NÆ = 1) /2 = 12.2429 N=4 
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Now we can determine H,(s). 


a = 44/145 = 4.1702 
E E 


a = 0.5 ( Va — Via) = 0.3646 


b= 0.5 ( Va + VIa) = 1.0644 


There are four poles for Ha(s): 


po,3 = (aM) cos E i z] + (bQ.) sin E $ z] = —0.0877 + j0.6179 


pi2 = (aQe) cos E s z] + (bQe) sin [5 As = = —0.2117 + j0.2559 
2 8 2 8 
Hence 
0.03829 
{CuTax—La— oO 
K 0.89125 x .1103 x .3895 
Ha(s) = = 
3 (s? + 0.17548 + 0.3895) (s? + 0.4234s + 0.1103) 
I] (s — pr) 
k=0 
Note that the numerator is such that 
1 
Ha(j0) = ——— = 0.89125 


Vite 


8.3.8 MATLAB IMPLEMENTATION 

Using the U_chbiap function, we provide a function called afd_chb1 to 
design an analog Chebyshev-II lowpass filter, given its specifications. This 
is shown below and uses the procedure described in Example 8.5. 


function [b,a] = afd_chb1(Wp,Ws,Rp,As) ; 
% Analog Lowpass Filter Design: Chebyshev-1 


% [b,a] = afd_chb1(Wp,Ws,Rp, As); 

% b = Numerator coefficients of Ha(s) 

% a = Denominator coefficients of Ha(s) 

% Wp = Passband edge frequency in rad/sec; Wp > 0 

% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
% Rp = Passband ripple in +dB; (Rp > 0) 

% As = Stopband attenuation in +dB; (As > 0) 
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h 
if Wp <= 0 
error(’Passband edge must be larger than 0’) 
end 
if Ws <= Wp 
error (’Stopband edge must be larger than Passband edge’) 
end 
if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt(107(Rp/10)-1); A = 10°(As/20); 

OmegaC = Wp; OmegaR = Ws/Wp; g = sqrt (A*A-1)/ep; 

N = ceil(log10(g+sqrt (g*g-1) ) /1og10 (OmegaR+sqrt (OmegaR*OmegaR-1) )) ; 
fprintf(’\n*** Chebyshev-1 Filter Order = %2.0f \n’,N) 
[b,a]=u_chbiap(N,Rp, OmegaC) ; 


EXAMPLE 8.6 Design the analog Chebyshev-I lowpass filter given in Example 8.5 using 
MATLAB. 


Solution MATLAB script: 


>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 1; As = 16; 
>> Ripple = 10 ^ (-Rp/20); Attn = 10 ~ (-As/20); 
>> % Analog filter design: 

>> [b,a] = afd_chb1(Wp,Ws,Rp,As) ; 

*** Chebyshev-1 Filter Order = 4 

>> % Calculation of second-order sections: 

>> [C,B,A] = sdir2cas(b,a) 


C = 0.0383 
B=0 (0) 1 
A = 1.0000 0.4233 0.1103 


1.0000 0.1753 0.3895 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 


The specifications are satisfied by a 4th-order Chebyshev-I filter whose system 
function is 


0.0383 
(s? + 4233s + 0.1103) (s2 + 0.17535 + 0.3895) 


Ha(s) = 


The filter plots are shown in Figure 8.16. 
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FIGURE 8.16 Chebyshev-I analog filter in Example 8.6 


A Chebyshev-II filter is related to the Chebyshev-I filter through a 
simple transformation. It has a monotone passband and an equiripple 
stopband, which implies that this filter has both poles and zeros in the 
s-plane. Therefore the group delay characteristics are better (and the 
phase response more linear) in the passband than the Chebyshey-I pro- 
totype. If we replace the term ¢€?T%,(Q/Q,) in (8.52) by its reciprocal and 
also the argument x = 2/Q, by its reciprocal, we obtain the magnitude- 
squared response of Chebyshev-II as 


1 
1+ [e2T2(2./2)]* 


|Ha (jQ)? = (8.60) 


One approach to designing a Chebyshev-II filter is to design the corre- 
sponding Chebyshev-I first and then apply these transformations. We will 
not discuss the details of this filter but will use a function from MATLAB 
to design a Chebyshev-II filter. 


8.3.9 MATLAB IMPLEMENTATION 

MATLAB provides a function called [z,p,k]=cheb2ap(N,As) to design a 
normalized Chebyshev-II analog prototype filter of order N and passband 
ripple As and that returns zeros in z array, poles in p array, and the gain 
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value k. We need an unnormalized Chebyshev-I filter with arbitrary Qe. 
This is achieved by scaling the array p of the normalized filter by Qe. Since 
this filter has zeros, we also have to scale the array z by Qe. The new gain 
k is determined using (8.56), which is achieved by scaling the old k by the 
ratio of the unnormalized to the normalized rational functions evaluated 
at s = 0. In the following function, called U_chb2ap(N,As,Omegac), we 
design an unnormalized Chebyshev-II analog prototype filter that returns 
H,(s) in the direct form. 


function [b,a] = u_chb2ap(N,As,Omegac) ; 
% Unnormalized Chebyshev-2 Analog Lowpass Filter Prototype 


Uj -------------------------------------------------------- 
% [b,a] = u_chb2ap(N,As,Omegac) ; 

hh b = numerator polynomial coefficients 

hh a = denominator polynomial coefficients 

h N = Order of the Elliptic Filter 

4h As = Stopband Ripple in dB; As > 0 

7, Omegac = Cutoff frequency in radians/sec 

% 


[z,p,k] = cheb2ap(N,As); 
a = real(poly(p)); aNn = a(N+1); 
p = p*Omegac; a = real(poly(p)); aNu = a(N+1); 
b = real(poly(z)); M = length(b); bNn = b(M); 
z = z*0megac; b = real(poly(z)); bNu = b(M); 
k = k*(aNu*bNn) /(aNn*bNu) ; 
bO = k; b = kxb; 


The design equations for the Chebyshev-II prototype are similar to 
those of the Chebyshev-I except that Qe = Qs since the ripples are in the 
stopband. Therefore we can develop a MATLAB function similar to the 
afd_chb1 function for the Chebyshev-II prototype. 


function [b,a] = afd_chb2(Wp,Ws,Rp,As) ; 
% Analog Lowpass Filter Design: Chebyshev-2 


% [b,a] = afd_chb2(Wp,Ws,Rp, As) ; 

% b = Numerator coefficients of Ha(s) 

% a = Denominator coefficients of Ha(s) 

% Wp = Passband edge frequency in rad/sec; Wp > 0 

% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 


% Rp = Passband ripple in +dB; (Rp > 0) 

% As = Stopband attenuation in +dB; (As > 0) 
% 

if Wp <= 0 


error(’Passband edge must be larger than 0’) 
end 
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if Ws <= Wp 
error(’Stopband edge must be larger than Passband edge’) 
end 
if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt(107(Rp/10)-1); A = 107(As/20); 

OmegaC = Wp; OmegaR = Ws/Wp; g = sqrt(A*A-1)/ep; 

N = ceil(log10(g+sqrt (g*g-1) )/1og10 (OmegaR+sqrt (OmegaR*OmegaR-1) ) ) ; 
fprintf(’\n*** Chebyshev-2 Filter Order = %2.0f \n’,N) 
[b,a]=u_chb2ap(N,As,Ws) ; 


EXAMPLE 8.7 Design a Chebyshevy-II analog lowpass filter to satisfy the specifications given 
in Example 8.5: 


Passband cutoff: Q, = 0.27 ; Passband ripple: Rp = 1dB 
Stopband cutoff: Qs = 0.37 ; Stopband ripple: As = 16dB 


Solution MATLAB script: 


>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 1; As = 16; 
>> Ripple = 10 ^ (-Rp/20); Attn = 10 ~ (-As/20); 
>> % Analog filter design: 

>> [b,a] = afd_chb2(Wp,Ws,Rp,As) ; 

*** Chebyshev-2 Filter Order = 4 

>> % Calculation of second-order sections: 

>> [C,B,A] = sdir2cas(b,a) 


C = 0.1585 

B = 1.0000 0 6.0654 
1.0000 0 1.0407 

A = 1.0000 1.9521 1.4747 


1.0000 0.3719 0.6784 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 


The specifications are satisfied by a 4th-order Chebyshev-II filter whose system 
function is 


0.1585 (s? + 6.0654) (s? + 1.0407) 


Ha = 7s 
(9) = (24 1.9521s $ L447) (e? + 0.37198 + 0.6784) 


The filter plots are shown in Figure 8.17. 
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FIGURE 8.17 Chebyshev-II analog filter in Example 8.7 


8.3.10 ELLIPTIC LOWPASS FILTERS 

These filters exhibit equiripple behavior in the passband as well as in 
the stopband. They are similar in magnitude response characteristics to 
the FIR equiripple filters. Therefore elliptic filters are optimum filters 
in that they achieve the minimum order N for the given specifications 
(or alternately, achieve the sharpest transition band for the given order 
N). These filters, for obvious reasons, are very difficult to analyze and, 
therefore, to design. It is not possible to design them using simple tools, 
and often programs or tables are needed to design them. 

The magnitude-squared response of elliptic filters is given by 


1 


Q 
1 + €?U2, (=) 


where N is the order, e is the passband ripple (which is related to Rp), 
and Uy(-) is the Nth-order Jacobian elliptic function. The analysis of 
this function, even on a superficial level, is beyond the scope of this book. 
Note the similarity between the preceding response (8.61) and that of the 
Chebyshev filters given by (8.52). Typical responses for odd and even N 
are as follows. 


|Ha(jQ)/? = (8.61) 
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8.3.11 COMPUTATION OF FILTER ORDER N 
Even though the analysis of (8.61) is difficult, the order calculation for- 
mula is very compact and is available in many textbooks [18, 23, 24]. It 


is given by 
K(k)K (vi = i) 
N= (8.62) 
K (kı) K (V1 — k?) 
where 
E 
s 4-1 
and 


T/2 dé 
rof —4 
0 1 — z? sin’ 0 


is the complete elliptic integral of the first kind. MATLAB provides the 
function ellipke to numerically compute the above integral, which we 
will use to compute N and to design elliptic filters. 


8.3.12 MATLAB IMPLEMENTATION 

MATLAB provides a function called [z,p,k]=ellipap(N,Rp,As) to de- 
sign a normalized elliptic analog prototype filter of order N, passband 
ripple Rp, and stopband attenuation As, and that returns zeros in z array, 
poles in p array, and the gain value k. We need an unnormalized elliptic 
filter with arbitrary Qe. This is achieved by scaling the arrays p and z of 
the normalized filter by Qe and the gain k by the ratio of the unnormalized 
to the normalized rational functions evaluated at s = 0. In the following 
function, called U_elipap(N,Rp,As,Omegac), we design an unnormalized 
elliptic analog prototype filter that returns H,(s) in the direct form. 
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function [b,a] = u_elipap(N,Rp,As,Omegac) ; 
% Unnormalized Elliptic Analog Lowpass Filter Prototype 


% [b,a] = u_elipap(N,Rp,As,Omegac) ; 


hh b = numerator polynomial coefficients 
hh a = denominator polynomial coefficients 
% N = Order of the Elliptic Filter 

h Rp = Passband Ripple in dB; Rp > 0 

% As = Stopband Attenuation in dB; As > 0 


% Omegac = Cutoff frequency in radians/sec 


[z,p,k] = ellipap(N,Rp,As); 
a = real(poly(p)); aNn = a(N+1); 
p = p*Omegac; a = real(poly(p)); aNu = a(N+1); 
b = real(poly(z)); M = length(b); bNn = bM); 
z = z*Omegac; b = real(poly(z)); bNu = b(M); 
k = k*(aNu*bNn) /(aNn*bNu) ; 
bO = k; b = kxb; 


Using the U_elipap function, we provide a function called afd_elip 
to design an analog elliptic lowpass filter, given its specifications. This 
follows and uses the filter order computation formula given in (8.62). 


function [b,a] = afd_elip(Wp,Ws,Rp,As) ; 
% Analog Lowpass Filter Design: Elliptic 
V oe eae Sea ia ee Com ats Seer oan mee eae Sn 
% [b,a] = afd_elip(Wp,Ws,Rp,As) ; 

% b = Numerator coefficients of Ha(s) 

% a = Denominator coefficients of Ha(s) 


% Wp = Passband edge frequency in rad/sec; Wp > 0 
% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
% Rp = Passband ripple in +dB; (Rp > 0) 
% As = Stopband attenuation in +dB; (As > 0) 
hh 
if Wp <= 0 

error(’Passband edge must be larger than 0’) 
end 
if Ws <= Wp 

error (’Stopband edge must be larger than Passband edge’) 
end 


if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt(10*(Rp/10)-1); A = 10°(As/20) ; 
OmegaC = Wp; k = Wp/Ws; k1 = ep/sqrt(A*A-1); 
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capk = ellipke([k.~2 1-k.*2]); % Version 4.0 code 

capki = ellipke([(k1 .~2) 1-(k1 .*2)]); % Version 4.0 code 
N = ceil(capk(1)*capk1(2)/(capk(2)*capk1i(1))); 
fprintf(’?\n*** Elliptic Filter Order = %2.0f \n’,N) 
[b,a]=u_elipap(N,Rp,As,OmegaC) ; 


EXAMPLE 8.8 Design an analog elliptic lowpass filter to satisfy the following specifications of 
Example 8.5: 


Q = 0.27, Rp =1dB 
Qs = 0.37, As = 16 db 


Solution MATLAB script: 


>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 1; As = 16; 

>> Ripple = 10 ~ (-Rp/20); Attn = 10 ~ (-As/20); 
>> % Analog filter design: 

>> [b,a] = afd_elip(Wp,Ws,Rp,As) ; 

*#* Elliptic Filter Order = 3 

>> % Calculation of second-order sections: 

>> [C,B,A] = sdir2cas(b,a) 


C = 0.2740 
B = 1.0000 0 0.6641 
A = 1.0000 0.1696 0.4102 


0 1.0000 0.4435 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 


The specifications are satisfied by a 3rd-order elliptic filter whose system func- 
tion is 
0.274 (s? + 0.6641) 


Ha(s) = 
(5) = 540.1696 + 04102) (= + 0.4435) 


The filter plots are shown in Figure 8.18. 


8.3.13 PHASE RESPONSES OF PROTOTYPE FILTERS 

Elliptic filters provide optimal performance in the magnitude-squared re- 
sponse but have highly nonlinear phase response in the passband (which is 
undesirable in many applications). Even though we decided not to worry 
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FIGURE 8.18 Elliptic analog lowpass filter in Example 8.8 


about phase response in our designs, phase is still an important issue in the 
overall system. At the other end of the performance scale are the Butter- 
worth filters, which have maximally flat magnitude response and require a 
higher-order N (more poles) to achieve the same stopband specification. 
However, they exhibit a fairly linear phase response in their passband. 
The Chebyshev filters have phase characteristics that lie somewhere in 
between. Therefore in practical applications we do consider Butterworth 
as well as Chebyshev filters, in addition to elliptic filters. The choice de- 
pends on both the filter order (which influences processing speed and 
implementation complexity) and the phase characteristics (which control 
the distortion). 


8.4 ANALOG-TO-DIGITAL FILTER TRANSFORMATIONS 
eee ae 


After discussing different approaches to the design of analog filters, we 
are now ready to transform them into digital filters. These transfor- 
mations are complex-valued mappings that are extensively studied in 
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the literature. These transformations are derived by preserving different 
aspects of analog and digital filters. If we want to preserve the shape 
of the impulse response from analog to digital filter, then we obtain a 
technique called impulse invariance transformation. If we want to con- 
vert a differential equation representation into a corresponding difference 
equation representation, then we obtain a finite difference approximation 
technique. Numerous other techniques are also possible. One technique, 
called step invariance, preserves the shape of the step response; this is 
explored in Problem P8.24. Another technique that is similar to the 
impulse invariance is the matched-z transformation, which matches the 
pole-zero representation. It is described at the end of this section and is 
explored in Problem P8.26. The most popular technique used in practice 
is called a Bilinear transformation, which preserves the system function 
representation from analog to digital domain. In this section we will study 
in detail impulse invariance and bilinear transformations, both of which 
can be easily implemented in MATLAB. 


8.4.1 IMPULSE INVARIANCE TRANSFORMATION 

In this design method we want the digital filter impulse response to look 
“similar” to that of a frequency-selective analog filter. Hence we sample 
h(t) at some sampling interval T to obtain h(n); that is, 


h(n) = ha(nT) 
The parameter T is chosen so that the shape of ha(t) is “captured” by 
the samples. Since this is a sampling operation, the analog and digital 
frequencies are related by 


w = QT or e” = JT 


Since z = ef” on the unit circle and s = jQ on the imaginary axis, we 
have the following transformation from the s-plane to the z-plane: 


z= eT (8.63) 


The system functions H(z) and H,(s) are related through the frequency- 
domain aliasing formula (3.27): 


mo ea 
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FIGURE 8.19 Complez-plane mapping in impulse invariance transformation 


The complex plane transformation under the mapping (8.63) is shown in 
Figure 8.19, from which we have the following observations: 


1. Using o = Re(s), we note that 
ao < 0 maps into |z| < 1 (inside of the UC) 
o = 0 maps onto |z| = 1 (on the UC) 
ao > 0 maps into |z| > 1 (outside of the UC) 


2. All semi-infinite strips (shown above) of width 27/T map into |z| < 1. 
Thus this mapping is not unique but a many-to-one mapping. 

3. Since the entire left half of the s-plane maps into the unit circle, a 
causal and stable analog filter maps into a causal and stable digital 
filter. 

4. If Ha(jQ) = Ha(gw/T) = 0 for |Q| > 2/T, then 


: 1 
H(el) = Hal jw/T), wl <a 


and there will be no aliasing. However, no analog filter of finite order 
can be exactly band-limited. Therefore some aliasing error will occur 
in this design procedure, and hence the sampling interval T plays a 
minor role in this design method. 


8.4.2 DESIGN PROCEDURE 

Given the digital lowpass filter specifications wp, ws, Rp, and As, we want 
to determine H(z) by first designing an equivalent analog filter and then 
mapping it into the desired digital filter. The steps required for this pro- 
cedure are 


1. Choose T and determine the analog frequencies 
“r 


wsp and aF 
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2. Design an analog filter H,(s) using the specifications Qp, Qs, Rp, and 
Ag. This can be done using any one of the three (Butterworth, Cheby- 
shev, or elliptic) prototypes of the previous section. 


3. Using partial fraction expansion, expand H,(s) into 


N 
R 
=> 


k=l Pk 


4. Now transform analog poles {px} into digital poles {e?*7} to obtain 
the digital filter: 


N 
=} — ra E Ta (8.64) 


k=1 


EXAMPLE 8.9 Transform 


s+1 


Hols) = Sy gs6 


into a digital filter H(z) using the impulse invariance technique in which 
T =0.1. 


Solution We first expand Ha(s) using partial fraction expansion: 


s+1 _ 2 1 
s?+5s+6 s+3 s+2 


H,(s) = 


The poles are at pı = —3 and p2 = —2. Then from (8.64) and using T = 0.1, 
we obtain 
2 1 1 — 0.896627 t 


H cate aa, 
(2) = eera er = To 5o52 + 0600822 


It is easy to develop a MATLAB function to implement the impulse invari- 
ance mapping. Given a rational function description of Ha(s), we can use the 
residue function to obtain its pole-zero description. Then each analog pole is 
mapped into a digital pole using (8.63). Finally, the residuez function can be 
used to convert H(z) into rational function form. This procedure is given in the 
function imp_invr. 


function [b,a] = imp_invr(c,d,T) 
% Impulse Invariance Transformation from Analog to Digital Filter 


% [b,a] = imp_invr(c,d,T) 

% b = Numerator polynomial in z*(-1) of the digital filter 
% a = Denominator polynomial in z^°(-1) of the digital filter 
% c = Numerator polynomial in s of the analog filter 
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% d = Denominator polynomial in s of the analog filter 
Sampling (transformation) parameter 


x 
4 
Il 


[R,p,k] = residue(c,d); p = exp(p*T); 
[b,a] = residuez(R,p,k); b = real(b’); a = real(a’); 


A similar function called impinvar is available in the SP toolbox of MATLAB. 


EXAMPLE 8.10 We demonstrate the use of the imp_invr function on the system function from 
Example 8.9. 


Solution MATLAB script: 


>> c = [1,1]; d = [1,5,6]; T = 0.1; 
>> [b,a] = imp_invr(c,d,T) 

b 1.0000 -0.8966 

a 1.0000 -1.5595 0.6065 


The digital filter is 


o 1 — 0.896627 * 
1 — 1.559527! + 0.606527? 


A(z) 


as expected. In Figure 8.20 we show the impulse responses and the magnitude 
responses (plotted up to the sampling frequency 1/T) of the analog and the 
resulting digital filter. Clearly, the aliasing in the frequency domain is evident. 


In the next several examples we illustrate the impulse invariance de- 
sign procedure on all three prototypes. 


EXAMPLE 8.11 Design a lowpass digital filter using a Butterworth prototype to satisfy 
wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 


Solution The design procedure is described in the following MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in Hz 
>> ws = 0.3*pi; % digital Stopband freq in Hz 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 
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Impulse Responses 


1e T 
0.8¢ 4 
-8 0.6} 4 
2 
20.47 7 
<x 
0.2} a 
0 66 5b 6 S 5-5 3 r a E 
L L L L L 
0 0.5 1 1.5 2 2.5 3 
time in sec 
Magnitude Responses 
3 T T T 


g2 7 

a 

= Digital filter 

D 

© 

241+ 4 
Analog filter 

0 1 L L a 1 ah L L L 
0 1 2 3 4 5 6 7 8 9 10 


frequency in Hz 


FIGURE 8.20 Impulse and frequency response plots in Example 8.10 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
Sh Ir = lp % Set T=1 

>> OmegaP = % Prototype Passband freq 

>> OmegaS % Prototype Stopband freq 


"oo 
ig 
So 
edge 


>> % Analog Butterworth Prototype Filter Calculation: 
>> [cs,ds] = afd_butt (OmegaP,OmegaS ,Rp, As) ; 
*k* Butterworth Filter Order = 6 


>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); [C,B,A] = dir2par(b,a) 
Gs {i 
B = 1.8557 -0.6304 
-2.1428 1.1454 
0.2871 -0.4466 
A = 1.0000 -0.9973 0.2570 
1.0000 -1.0691 0.3699 
1.0000 -1.2972 0.6949 
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FIGURE 8.21 Digital Butterworth lowpass filter using impulse invariance design 


The desired filter is a 6th-order Butterworth filter whose system function H(z) 


is given in the parallel form 


1.8587 — 0.630427! —2.1428 + 1.145427! 
1 — 0.9973z-! + 0.257272 ` 1—1.0691z-! + 0.3699z-2 


A(z) = 


0.2871 — 0.446327? 
1 — 1.297227! + 0.644922 


The frequency response plots are given in Figure 8.21. 


EXAMPLE 8.12 Design a lowpass digital filter using a Chebyshev-I prototype to satisfy 


Wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 


Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


430 Chapter 8 m IIR FILTER DESIGN 


Solution The design procedure is described in the following MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 
>> ws = 0.3*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 


>> T= 1; % Set T=1 
>> OmegaP = wp / T; % Prototype Passband freq 
>> OmegaS = ws / T; % Prototype Stopband freq 


>> % Analog Chebyshev-1 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb1(OmegaP,OmegaS ,Rp,As) ; 
*** Chebyshev-1 Filter Order = 4 


>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); [C,B,A] = dir2par(b,a) 
c= [ 
B =-0.0833 -0.0246 
0.0833 0.0239 
A = 1.0000 -1.4934 0.8392 
1.0000 -1.5658 0.6549 


The desired filter is a 4th-order Chebyshev-I filter whose system function H(z) is 


— —0.0833 — 0.024621 —0.0833 + 0.023927! 
1 — 1.4934z-1 + 0.8392z72 1 — 1.565827! + 0.6549z-? 


A(z) 


The frequency response plots are given in Figure 8.22. 


EXAMPLE 8.13 Design a lowpass digital filter using a Chebyshev-II prototype to satisfy 


Wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 


Solution Recall that the Chebyshev-II filter is equiripple in the stopband. It means that 
this analog filter has a response that does not go to zero at high frequencies in 
the stopband. Therefore after impulse invariance transformation, the aliasing 
effect will be significant; this can degrade the passband response. The MATLAB 
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FIGURE 8.22 Digital Chebyshev-I lowpass filter using impulse invariance design 


script follows: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 
>> ws = 0.3*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
S> TF = ile % Set T=1 

>> OmegaP = % Prototype Passband freq 

>> OmegaS % Prototype Stopband freq 


"od 
ae 
SOS 
sd 


>> % Analog Chebyshev-1 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb2(OmegaP,OmegaS ,Rp,As) ; 
*** Chebyshev-2 Filter Order = 4 


>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); [C,B,A] = dir2par(b,a); 
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FIGURE 8.23 Digital Chebyshev-II lowpass filter using impulse invariance 
design 


From the frequency response plots in Figure 8.23 we clearly observe the pass- 
band as well as stopband degradation. Hence the impulse invariance design 
technique has failed to produce a desired digital filter. 


EXAMPLE 8.14 Design a lowpass digital filter using an elliptic prototype to satisfy 


wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 
Solution The elliptic filter is equiripple in both bands. Hence this situation is similar to 


that of the Chebyshev-II filter, and we should not expect a good digital filter. 
The MATLAB script follows: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 
>> ws = 0.3*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 
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FIGURE 8.24 Digital elliptic lowpass filter using impulse invariance design 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
SS 7 = ile % Set T=1 

>> OmegaP = 
>> Omegas 


I 
5 
S5 
a 


% Prototype Passband freq 
% Prototype Stopband freq 


Il 

a 
oS 
T 


>> % Analog Elliptic Prototype Filter Calculation: 
>> [cs,ds] = afd_elip(OmegaP,OmegaS,Rp,As) ; 
¥** Elliptic Filter Order = 3 


>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); [C,B,A] = dir2par(b,a); 


From the frequency response plots in Figure 8.24 we clearly observe that once 
again the impulse invariance design technique has failed. 


The advantages of the impulse invariance mapping are that it is a 
stable design and that the frequencies Q and w are linearly related. But 
the disadvantage is that we should expect some aliasing of the ana- 
log frequency response, and in some cases this aliasing is intolerable. 
Consequently, this design method is useful only when the analog filter 
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is essentially band-limited to a lowpass or bandpass filter in which there 
are no oscillations in the stopband. 


8.4.3 BILINEAR TRANSFORMATION 
This mapping is the best transformation method; it involves a well-known 
function given by 


21-271 _ 1+sT/2 


orme Ie ve 


where T is a parameter. Another name for this transformation is the linear 
fractional transformation because when cleared of fractions, we obtain 


T T 
z5% t 387tl =0 


which is linear in each variable if the other is fixed, or bilinear in s and z. 
The complex plane mapping under (8.65) is shown in Figure 8.25, from 
which we have the following observations: 


1. Using s = o + jQ in (8.65), we obtain 


oT QT oT QT 
EN Oe ee eee res oie 8.66 
Saas) oO 
Hence 
1474; 
o <0 => l= | <1 
a) 
14+ 982 
pistes. || ee 2g 
1+ Z 4422 
o >0 = |z| = Ter E Sa 
2 J 9 
jQ Im {z2} 
A A 
Unit Circle 
>o One-to-one > Re {2} 
Transformation 
1+(sT/2) 
1-(sT/2) 7 
s-plane z-plane 


FIGURE 8.25 Complez-plane mapping in bilinear transformation 
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2. The entire left half-plane maps into the inside of the unit circle. Hence 
this is a stable transformation. 


3. The imaginary axis maps onto the unit circle in a one-to-one fashion. 
Hence there is no aliasing in the frequency domain. 


Substituting ø = 0 in (8.66), we obtain 


QT 
_ a eee = eiv 
QT 


since the magnitude is 1. Solving for w as a function of Q, we obtain 


QT 2 w 
= aS Lifes me | at pai 
w = 2tan ( ) or Q E tan ( 5 ) (8.67) 


This shows that Q is nonlinearly related to (or warped into) w but that 
there is no aliasing. Hence in (8.67) we will say that w is prewarped into Q. 


EXAMPLE 8.15 ‘Transform H,(s) = gE into a digital filter using the bilinear transfor- 
s? +5s +6 
mation. Choose T = 1. 
Solution Using (8.65), we obtain 
et aga 
H(2) = Ha 2 1-z -H 21 zZ 
Tip! Ipan 
T=1 
12-7 
1 
1+271 g 


Simplifying, 


20 + 4z-1 1 + 0.2271 


MATLAB provides a function called bilinear to implement this 
mapping. Its invocation is similar to the imp-invr function, but it also 
takes several forms for different input-output quantities. The SP tool- 
box manual should be consulted for more details. Its use is shown in the 
following example. 
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EXAMPLE 8.16 ‘Transform the system function H,(s) in Example 8.15 using the bilinear func- 
tion. 


Solution MATLAB script: 


>> c = [1,1]; d = [1,5,6]; T = 1; Fs = 1/T; 
>> [b,a] = bilinear(c,d,Fs) 

b = 0.1500 0.1000 -0.0500 

a = 1.0000 0.2000 0.0000 


The filter is 


_ 0.15 + 0.1271 — 0.0527? 
1+0.22-1 


A(z) 


as before. 


8.4.4 DESIGN PROCEDURE 
Given digital filter specifications wp, ws, Rp, and As, we want to determine 
H(z). The design steps in this procedure are the following: 


1. Choose a value for T. This is arbitrary, and we may set T = 1. 


2. Prewarp the cutoff frequencies wp and ws; that is, calculate Q, and Qs 
using (8.67): 


gy Z tan (2), a= * tan (=) (8.68) 


3. Design an analog filter H,(s) to meet the specifications Qy, Qs, Rp, 
and A,. We have already described how to do this in the previous 
section. 


4. Finally, set 
21—27! 
HG) = H, | L 
(2) (z TF =) 
and simplify to obtain H(z) as a rational function in 271. 


In the next several examples we demonstrate this design procedure 
on our analog prototype filters. 


EXAMPLE 8.17 Design the digital Butterworth filter of Example 8.11. The specifications are 


Wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 
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Solution MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 

>> ws = 0.3*pi; % digital Stopband freq in rad 

>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 

>> % Analog Prototype Specifications: Inverse mapping for frequencies 
SP = als ioe = lAr % Set T=1 

>> OmegaP = (2/T)*tan(wp/2) ; % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; % Prewarp Prototype Stopband freq 


>> % Analog Butterworth Prototype Filter Calculation: 
>> [cs,ds] = afd_butt (OmegaP,OmegaS,Rp,As) ; 

xxx Butterworth Filter Order = 6 

>> % Bilinear transformation: 

>> [b,a] = bilinear(cs,ds,Fs); [C,B,A] = dir2cas(b,a) 
C = 5.7969e-004 


B = 1.0000 2.0183 1.0186 
1.0000 1.9814 0.9817 
1.0000 2.0004 1.0000 

A = 1.0000 -0.9459 0.2342 
1.0000 -1.0541 0.3753 
1.0000 -1.3143 0.7149 


The desired filter is once again a 6th-order filter and has 6 zeros. Since the 


6th-order zero of Ha(s) at s = —co is mapped to z = —1, these zeros should be 
at z = —1. Due to the finite precision of MATLAB these zeros are not exactly 
at z = —1. Hence the system function should be 


0.00057969 (1 + 2~")° 


H — 
(2) (1 = 0.945927! + 0.234227?) (1 — 1.054127! + 0.375327?) (1 — 1.31432—! + 0.7149z-?) 


The frequency response plots are given in Figure 8.26. Comparing these plots 
with those in Figure 8.21, we observe that these two designs are very similar. 


EXAMPLE 8.18 Design the digital Chebyshev-I filter of Example 8.12. The specifications are 


wp = 0.27, Rp = 1 dB 
ws =0.37, As = 15 dB 
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FIGURE 8.26 Digital Butterworth lowpass filter using bilinear transformation 


Solution MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 

>> ws = 0.3*pi; % digital Stopband freq in rad 

>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 

>> % Analog Prototype Specifications: Inverse mapping for frequencies 

SS = ils i = Ap % Set T=1 

>> OmegaP = (2/T)*tan(wp/2) ; % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; % Prewarp Prototype Stopband freq 


>> % Analog Chebyshev-1 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb1(OmegaP,OmegaS,Rp,As) ; 

*** Chebyshev-1 Filter Order = 4 

>> % Bilinear transformation: 

>> [b,a] = bilinear(cs,ds,Fs); [C,B,A] = dir2cas(b,a) 
C = 0.0018 


B = 1.0000 2.0000 1.0000 
1.0000 2.0000 1.0000 
A = 1.0000 -1.4996 0.8482 


1.0000 -1.5548 0.6493 
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FIGURE 8.27 Digital Chebyshev-I lowpass filter using bilinear transformation 
The desired filter is a 4th-order filter and has 4 zeros at z = —1. The system 


function is 


0.0018 (1+ 271)" 
(1 — 1.49962—! + 0.848222) (1 — 1.55487 | + 0.64932?) 


H(z) = 


The frequency response plots are given in Figure 8.27 which are similar to those 


in Figure 8.22. 


EXAMPLE 8.19 Design the digital Chebyshev-II filter of Example 8.13. The specifications are 


wp = 0.27, Rp = 1 dB 


ws = 0.37, As = 15 dB 
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Solution MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 

>> ws = 0.3*pi; % digital Stopband freq in rad 

>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 

>> % Analog Prototype Specifications: Inverse mapping for frequencies 

SS P= als ie = l/s % Set T=1 

>> OmegaP = (2/T)*tan(wp/2) ; % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; % Prewarp Prototype Stopband freq 


>> % Analog Chebyshev-2 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb2(OmegaP,OmegaS,Rp,As) ; 

xxx Chebyshev-2 Filter Order = 4 

>> % Bilinear transformation: 

>> [b,a] = bilinear(cs,ds,Fs); [C,B,A] = dir2cas(b,a) 
C = 0.1797 


B = 1.0000 0.5574 1.0000 
1.0000 -1.0671 1.0000 
A = 1.0000 -0.4183 0.1503 
1.0000 Sb 1325 0.7183 


The desired filter is again a 4th-order filter with system function 


0.1797 (1 + 0.557427" + z7?) (1 — 1.067127} + 27?) 
(1 — 0.418327! + 0.150327?) (1 — 1.132527! + 0.718327?) 


H(z) = 


The frequency response plots are given in Figure 8.28. Note that the bilinear 
transformation has properly designed the Chebyshev-II digital filter. 


EXAMPLE 8.20 Design the digital elliptic filter of Example 8.14. The specifications are 


Wp = 0.27, Rp = 1 dB 
ws = 0.37, As = 15 dB 


Solution MATLAB script: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; % digital Passband freq in rad 
>> ws = 0.3*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
Sm Wt S Gl We = Glee % Set T=1 
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FIGURE 8.28 Digital Chebyshev-II lowpass filter using bilinear transformation 


>> OmegaP = (2/T)*tan(wp/2) ; % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; % Prewarp Prototype Stopband freq 
>> % Analog Elliptic Prototype Filter Calculation: 

>> [cs,ds] = afd_elip(OmegaP,OmegaS,Rp,As) ; 

xxx Elliptic Filter Order = 3 

>> % Bilinear transformation: 

>> [b,a] = bilinear(cs,ds,Fs); [C,B,A] = dir2cas(b,a) 


C = 0.1214 

B = 1.0000 -1.4211 1.0000 
1.0000 1.0000 (0) 

A = 1.0000 -1.4928 0.8612 
1.0000 -0.6183 (0) 


The desired filter is a 3rd-order filter with system function 


0.1214 (1 — 1.421127" + 27?) (1+ 27t) 
(1 — 1.49282-1 + 0.861227?) (1 — 0.618327") 


H(z) = 


The frequency response plots are given in Figure 8.29. Note that the bilinear 
transformation has again properly designed the elliptic digital filter. 
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FIGURE 8.29 Digital elliptic lowpass filter using bilinear transformation 


The advantages of this mapping are that (a) it is a stable design, 
(b) there is no aliasing, and (c) there is no restriction on the type of filter 
that can be transformed. Therefore this method is used exclusively in 
computer programs including MATLAB, as we shall see next. 


8.4.5 MATCHED-z TRANSFORMATION 

In this method of filter transformation, zeros and poles of H,(s) are di- 
rectly mapped into zeros and poles in the z-plane using an exponential 
function. Given a root (zero or pole) at the location s = a in the s-plane, 
we map it in the z-plane at z = eff where T is a sampling interval. Thus, 
the system function H,(s) with zeros {z,} and poles {pe} is mapped into 
the digital filter system function H(z) as 


Iei (8 — 24) eve) 
=—N A(z) = =5 (8.69) 
L= (5 — pe) Le- (s — eT 27t) 
Clearly the z-transform system function is “matched” to the s-domain 
system function. 
Note that this technique appears to be similar to the impulse invari- 


ance mapping in that the pole locations are identical and aliasing is un- 
avoidable. However, these two techniques differ in zero locations. Also the 


Ha(s) 
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matched-z transformation does not preserve either the impulse response 
or the frequency response characteristics. Hence it is suitable when de- 
signing using pole-zero placement, but it is generally unsuitable when the 
frequency-domain specifications are given. 


8.5 LOWPASS FILTER DESIGN USING MATLAB 
—— g 


In this section we will demonstrate the use of MATLAB’s filter design 
functions to design digital lowpass filters. These functions use the bilinear 
transformation because of its desirable advantages as discussed in the 
previous section. These functions are as follows: 


1. [b,a]=butter(N,wn) 
This function designs an Nth-order lowpass digital Butterworth filter 
and returns the filter coefficients in length N + 1 vectors b and a. The 
filter order is given by (8.49), and the cutoff frequency wn is determined 
by the prewarping formula (8.68). However, in MATLAB all digital 
frequencies are given in units of 7. Hence wn is computed by using the 


following relation: 
2 i (=) 
Wn = — tan 
T 2 


The use of this function is given in Example 8.21. 

2. [b,a]=cheby1(N,Rp,wn) 
This function designs an Nth-order lowpass digital Chebyshev-I filter 
with Rp decibels of ripple in the passband. It returns the filter coef- 
ficients in length N + 1 vectors b and a. The filter order is given by 
(8.59), and the cutoff frequency wn is the digital passband frequency 
in units of 7; that is, 


Wn = Wp/T 


The use of this function is given in Example 8.22. 
3. [b,a]=cheby2(N,As,wn) 
This function designs an Nth-order lowpass digital Chebyshev-II filter 
with the stopband attenuation As decibels. It returns the filter coef- 
ficients in length N + 1 vectors b and a. The filter order is given by 
(8.59), and the cutoff frequency wn is the digital stopband frequency 
in units of 7; that is, 
Wn = Ws |T 


The use of this function is given in Example 8.23. 
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4. [b,a]=ellip(N,Rp,As,wn) 
This function designs an Nth-order lowpass digital elliptic filter with 
the passband ripple of Rp decibels and a stopband attenuation of As 
decibels. It returns the filter coefficients in length N + 1 vectors b and 
a. The filter order is given by (8.62), and the cutoff frequency wn is the 
digital passband frequency in units of 7; that is, 


Wn = Wp /T 
The use of this function is given in Example 8.24. 


All these above functions can also be used to design other frequency- 
selective filters, such as highpass and bandpass. We will discuss their 
additional capabilities in Section 8.6. 

There is also another set of filter functions, namely the buttord, 
cheblord, cheb2ord, and ellipord functions, which can provide filter 
order N and filter cutoff frequency wn, given the specifications. These 
functions are available in the Signal Processing toolbox. In the examples 
to follow we will determine these parameters using the formulas given 
earlier. We will discuss the filter-order functions in the next section. 

In the following examples we will redesign the same lowpass filters 
of previous examples and compare their results. The specifications of the 
lowpass digital filter are 


wp = 0.27, Rp = 1 dB 
ws = 0.3m, As = 15 dB 


EXAMPLE 8.21 Digital Butterworth lowpass filter design: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; %digital Passband freq in rad 
>> ws = 0.3*pi; “digital Stopband freq in rad 
>> Rp = 1; %Passband ripple in dB 

>> As = 15; ZStopband attenuation in dB 


>> % Analog Prototype Specifications: 


>> T= 1; “Set T=1 
>> OmegaP = (2/T)*tan(wp/2) ; %Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; %Prewarp Prototype Stopband freq 


>> % Analog Prototype Order Calculation: 

>> N =ceil((10g10( (107 (Rp/10)-1)/ (107 (As/10)-1) )) /(2*10g10 (OmegaP/OmegaS) ) ) ; 
>> fprintf(’\n*** Butterworth Filter Order = %2.0f \n’,N) 

** Butterworth Filter Order = 6 

>> OmegaC = OmegaP/((107 (Rp/10)-1)~(1/(2*N))); “Analog BW prototype cutoff 
>> wn = 2*atan((OmegaC*T) /2) ; %Digital BW cutoff freq 
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>> % Digital Butterworth Filter Design: 

>> wn = wn/pi; “Digital Butter cutoff in pi units 
>> [b,a]l=butter(N,wn); [b0,B,A] = dir2cas(b,a) 

C = 5.7969e-004 


B = 1.0000 2.0297 1.0300 
1.0000 iL SRI 1.0000 
1.0000 1.9706 0.9709 

A = 1.0000 -0.9459 0.2342 
1.0000 -1.0541 0.3753 
1.0000 -1.3143 0.7149 


The system function is 


0.00057969 (1 + 2~1)° 
(10.94592! + 0.234222) (1 — 1.05412—! + 0.375322) (1 — 1.31432 -1 + 0.71492-2) 


H(z) = 


which is the same as in Example 8.17. The frequency-domain plots were shown 
in Figure 8.26. 


EXAMPLE 8.22 Digital Chebyshev-I lowpass filter design: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; ydigital Passband freq in rad 
>> ws = 0.3*pi; “digital Stopband freq in rad 
>> Rp = 1; %Passband ripple in dB 

>> As = 15; ZStopband attenuation in dB 


>> % Analog Prototype Specifications: 


>> T= 1; Set T=1 
>> OmegaP = (2/T)*tan(wp/2) ; %Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; %Prewarp Prototype Stopband freq 


>> % Analog Prototype Order Calculation: 


>> ep = sqrt (107 (Rp/10)-1); %Passband Ripple Factor 

>> A = 107(As/20) ; ZStopband Attenuation Factor 

>> OmegaC = OmegaP; Analog Prototype Cutoff freq 

>> OmegaR = OmegaS/OmegaP ; Analog Prototype Transition Ratio 
>> g = sqrt (A*A-1)/ep; Analog Prototype Intermediate cal. 


>> N = ceil(log10(gtsqrt (g*g-1) ) /1og10 (OmegaR+sqrt (OmegaR*OmegaR-1) ) ) ; 

>> fprintf(’\n*** Chebyshev-1 Filter Order = %2.0f \n’,N) 

*** Chebyshev-1 Filter Order = 4 

>> % Digital Chebyshev-I Filter Design: 

>> wn = wp/pi; “Digital Passband freq in pi units 
>> [b,a]=cheby1(N,Rp,wn); [b0,B,A] = dir2cas(b,a) 
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bO = 0.0018 

B = 1.0000 2.0000 1.0000 
1.0000 2.0000 1.0000 

A = 1.0000 -1.4996 0.8482 
1.0000 -1.5548 0.6493 


The system function is 


0.0018 (1+ 271)" 


as (1 — 1.4996z-! + 0.84822~2) (1 — 1.55482-! + 0.6493z-2) 


which is the same as in Example 8.18. The frequency-domain plots were shown 
in Figure 8.27. 


EXAMPLE 8.23 Digital Chebyshev-II lowpass filter design: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; %digital Passband freq in rad 
>> ws = 0.3*pi; “digital Stopband freq in rad 
>> Rp = 1; %Passband ripple in dB 

>> As = 15; ZStopband attenuation in dB 


>> % Analog Prototype Specifications: 


>> T= 1; “Set T=1 
>> OmegaP = (2/T)*tan(wp/2) ; %Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2) ; #Prewarp Prototype Stopband freq 


>> % Analog Prototype Order Calculation: 


>> ep = sqrt(10*(Rp/10)-1) ; %Passband Ripple Factor 

>> A = 107 (As/20); “ZStopband Attenuation Factor 

>> OmegaC = OmegaP; “Analog Prototype Cutoff freq 

>> OmegaR = OmegaS/OmegaP ; “Analog Prototype Transition Ratio 
>> g = sqrt (A*A-1)/ep; “Analog Prototype Intermediate cal. 
>> N = ceil(log10(gtsqrt (g*g-1) ) /log10 (OmegaR+sqrt (OmegaR*OmegaR-1) )) ; 


>> fprintf(’\n*** Chebyshev-2 Filter Order = %2.0f \n’,N) 
*** Chebyshev-2 Filter Order = 4 


>> % Digital Chebyshev-II Filter Design: 


>> wn = ws/pi; “Digital Stopband freq in pi units 
>> [b,a]=cheby2(N,As,wn); [b0,B,A] = dir2cas(b,a) 
bO = 0.1797 
B = 1.0000 0.5574 1.0000 
1.0000 -1.0671 1.0000 
A = 1.0000 -0.4183 0.1503 
1.0000 -1.1325 0.7183 
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>> 
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>> 
>> 
>> 
>> 


>> 


EXAMPLE 8.24 


sign Using MATLAB 


The system function is 


447 


0.1797 (1 + 0.557427" + z7?) (1 — 1.067127} + 27?) 


H(z) = 


(1 — 0.418327! + 0.1503z~2) (1 — 1.1325z-! + 0.718327?) 


which is the same as in Example 8.19. The frequency-domain plots were shown 


in Figure 8.28. 


% Digital Filter Specifications: 


wp = 0.2*pi; 

ws = 0.3*pi; 

Rp = 1; 

ASERS; 

% Analog Prototype Specifications: 


RES 
OmegaP 
Omegas 


(2/T) *tan(wp/2) ; 
(2/T) *tan(ws/2) ; 


Digital elliptic lowpass filter design: 


%digital Passband freq in rad 
%digital Stopband freq in rad 
%Passband ripple in dB 
ZStopband attenuation in dB 


“Set T=1 
%Prewarp Prototype Passband freq 
%Prewarp Prototype Stopband freq 


% Analog Elliptic Filter order calculations: 


>> ep = sqrt(107 (Rp/10)-1) ; #Passband Ripple Factor 

>> A = 10°(As/20) ; ZStopband Attenuation Factor 

>> OmegaC = OmegaP; “Analog Prototype Cutoff freq 

>> k = OmegaP/Omegas ; “Analog Prototype Transition Ratio; 
>> k1 = ep/sqrt (A*A-1) ; /Analog Prototype Intermediate cal. 
>> capk = ellipke([k.*2 1-k.°2]); 

>> capki = ellipke([(k1 .~2) 1-(k1 .72)]); 

>> N = ceil(capk(1)*capk1 (2) /(capk(2)*capk1(1))); 

>> fprintf(’?\n*** Elliptic Filter Order = /%2.0f \n’,N) 


*** Elliptic Filter Order = 3 


>> % Digital Elliptic Filter Design: 


>> wn = wp/pi; “Digital Passband freq in pi units 
>> [b,a]=ellip(N,Rp,As,wn); [b0,B,A] = dir2cas(b,a) 
bO = 0.1214 
B = 1.0000 -1.4211 1.0000 
1.0000 1.0000 (0) 
A = 1.0000 -1.4928 0.8612 
1.0000 -0.6183 (0) 


The system function is 


0.1214 (1 — 1.4211z7' + 277) (1 +27?) 
(1 — 1.492827! + 0.861227?) (1 — 0.618327!) 


H(z) = 


which is the same as in Example 8.20. The frequency-domain plots were shown 
in Figure 8.29. 
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TABLE 8.1 Comparison of three filters 


Prototype Order N Stopband Att. 
Butterworth 6 15 
Chebyshev-I 4 25 
Elliptic 3 27 


8.5.1 COMPARISON OF THREE FILTERS 
In our examples we designed the same digital filter using four different 
prototype analog filters. Let us compare their performance. The specifi- 
cations were wp = 0.27, Rp = 1 dB, ws = 0.37, and A, = 15 dB. This 
comparison in terms of order N and the minimum stopband attenuations 
is shown in Table 8.1. 

Clearly, the elliptic prototype gives the best design. However, if we 
compare their phase responses, then the elliptic design has the most non- 
linear phase response in the passband. 


8.6 FREQUENCY-BAND TRANSFORMATIONS 
eee eee 


In the preceding two sections we designed digital lowpass filters from 
their corresponding analog filters. Certainly, we would like to design other 
types of frequency-selective filters, such as highpass, bandpass, and band- 
stop. This is accomplished by transforming the frequency axis (or band) 
of a lowpass filter so that it behaves as another frequency-selective fil- 
ter. These transformations on the complex variable z are very similar 
to bilinear transformations, and the design equations are algebraic. The 
procedure to design a general frequency-selective filter is to first design 
a digital prototype (of fixed bandwidth, say unit bandwidth) lowpass fil- 
ter and then to apply these algebraic transformations. In this section we 
will describe the basic philosophy behind these mappings and illustrate 
their mechanism through examples. MATLAB provides functions that 
incorporate frequency-band transformation in the s-plane. We will first 
demonstrate the use of the z-plane mapping and then illustrate the use 
of MATLAB functions. Typical specifications for most commonly used 
types of frequency-selective digital filters are shown in Figure 8.30. 

Let Hr p(Z) be the given prototype lowpass digital filter, and let H(z) 
be the desired frequency-selective digital filter. Note that we are using 
two different frequency variables, Z and z, with Hz p and H, respectively. 
Define a mapping of the form 


ZS Go-*) 
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FIGURE 8.30 Specifications of frequency-selective filters 


such that 
H(z) = Hrp(Z)|z-1=a-) 


To do this, we simply replace Z7! everywhere in Hzp by the function 
G(z~'). Given that Hzp(Z) is a stable and causal filter, we also want 
H(z) to be stable and causal. This imposes the following requirements: 


1. G(-) must be a rational function in z~' so that H(z) is implementable. 

2. The unit circle of the Z-plane must map onto the unit circle of the 
z-plane. 

3. For stable filters, the inside of the unit circle of the Z-plane must also 
map onto the inside of the unit circle of the z-plane. 


Let w” and w be the frequency variables of Z and z, respectively—that 
is, Z = e)” and z = e” on their respective unit circles. Then requirement 
2 above implies that 


2-4] = ee] = ee] =1 
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and l 
evi |G(e-3)| eiZGle’*) 


or 
—w' = LG(e3) 
The general form of the function G(-) that satisfies these requirements is 
a rational function of the all-pass type given by 
n 1 


= í Z —a 
cde ei ——= 


1 — apz— 
k=1 k 


where |ag| < 1 for stability and to satisfy requirement 3. 

Now by choosing an appropriate order n and the coefficients {a;,}, we 
can obtain a variety of mappings. The most widely used transformations 
are given in Table 8.2. We will now illustrate the use of this table for 
designing a highpass digital filter. 


EXAMPLE 8.25 In Example 8.22 we designed a Chebyshev-I lowpass filter with specifications 


wp =0.27, Rp = 1 dB 
w, = 0.37, A. = 15 dB 
and determined its system function 


0.001836(1 + Z~1)4 
(1 — 1.4996Z-! + 0.8482Z-2)(1 — 1.5548Z—! + 0.649322) 


Hyp(Z) = 


Design a highpass filter with these tolerances but with passband beginning at 
Wp = 0.67. 


Solution We want to transform the given lowpass filter into a highpass filter such that 
the cutoff frequency wp = 0.27 is mapped onto the cutoff frequency wp = 0.67. 
From Table 8.2 


cos|(0.2m + 0.67) /2] _ 
cos|(0.27 — 0.677) /2] 


0.38197 (8.70) 


Hence 


Hrp(z) = A(Z)| _ 271 0.38197 
1—0.38197z—1 


0.02426(1 — z~)* 
(1 + 0.566127} + 0.7657z-2)(1 + 1.041627! + 0.4019z-2) 


yim 


which is the desired filter. The frequency response plots of the lowpass filter 
and the new highpass filter are shown in Figure 8.31. 
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TABLE 8.2 Frequency transformation for digital filters (prototype lowpass filter has cutoff 
frequency w) 


Type of 
Transformation Transformation Parameters 
1 zt—a 
Lowpass Zo apt We = cutoff frequency of new filter 
— az 
_ sin (w4 — we) /2] 
sin [(wi + we) /2] 
z ita 
Highpass ON a = 7 We = cutoff frequency of new filter 
az 
cos [(we + we) /2] 
cos [(w4 — we) /2] 
2 -1 
Bandpass zt Aa ot ~ we = lower cutoff frequency 
Wu = upper cutoff frequency 
ay = —26K/(K +1) 
az = (K — 1)/(K +1) 
B cos [(wu + we) /2] 
~ cos |(wu — we) /2] 
/ 
K = cot & 5 We tan = 
-1 Zz — az} + a2 
Bandstop 2 we = lower cutoff frequency 


Wu = upper cutoff frequency 
ar = —26/(K + 1) 
a2 = (K —-1)/(K +1) 


cos [(wu + we) /2] 
cos [(wu — we) /2] 


B= 


Ketan > gy 
2 2 


From this example it is obvious that to obtain the rational function 
of a new digital filter from the prototype lowpass digital filter, we should 
be able to implement rational function substitutions from Table 8.2. This 
appears to be a difficult task, but since these are algebraic functions, we 
can use the conv function repetitively for this purpose. The following 
zmapping function illustrates this approach. 
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FIGURE 8.31 Magnitude response plots for Example 8.25 


function [bz,az] = zmapping(bZ,aZ,Nz,Dz) 
% Frequency band Transformation from Z-domain to z-domain 


% (bz,az] = zmapping(bZ,aZ,Nz,Dz) 
% performs: 


hh b(z) b(Z) | 

hh a N(z) 

hh a(z)  a(Z)|@Z = ---- 

h D(z) 

hh 

bNzord = (length(bZ)-1)*(length(Nz)-1) ; 


aDzord = (length(aZ)-1)*(length(Dz)-1) ; 
bzord = length(bZ)-1; azord = length(aZ)-1; 
bz = zeros(1,bNzord+1) ; 
for k = 0:bzord 

pln = [1]; 

for 1 = 0:k-1 

pln = conv(pln,Nz); 
end 
pld = [1]; 
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for 1 = 0:bzord-k-1 
pld = conv(pld,Dz) ; 
end 
bz = bz+bZ(k+1)*conv(pln,pld) ; 


az = zeros(1,aDzord+1) ; 
for k = O:azord 
pln = [1]; 
for 1 = 0:k-1 
pln = conv(pln,Nz); 
end 
pld = [1]; 
for 1 = O:azord-k-1 
pld = conv(pld,Dz); 
end 
az = aztaZ(kt1)*conv(pln,pld) ; 
end 


EXAMPLE 8.26 Use the zmapping function to perform the lowpass-to-highpass transformation 
in Example 8.25. 


Solution First we will design the lowpass digital filter in MATLAB using the bilinear 
transformation procedure and then use the zmapping function. 


MATLAB script: 


>> % Digital Lowpass Filter Specifications: 


>> wplp = 0.2*pi; % digital Passband freq in rad 
>> wslp = 0.3*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 


>> T= 1; Fs = 1/T; % Set T=1 
>> OmegaP = (2/T)*tan(wplp/2) ; % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(wslp/2) ; % Prewarp Prototype Stopband freq 


>> % Analog Chebyshev Prototype Filter Calculation: 
>> [cs,ds] = afd_chbi(OmegaP,OmegaS,Rp,As) ; 
** Chebyshev-1 Filter Order = 4 


>> % Bilinear transformation: 
>> [blp,alp] = bilinear(cs,ds,Fs) ; 
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>> % Digital Highpass Filter Cutoff frequency: 
>> wphp = 0.6*pi; % Passband edge frequency 


>> % LP-to-HP frequency-band transformation: 
>> alpha = -(cos((wplptwphp) /2))/(cos((wplp-wphp) /2) ) 
alpha = -0.3820 


>> Nz = -[alpha,1]; Dz = [1,alpha]; 
>> [bhp,ahp] = zmapping(blp,alp,Nz,Dz); [C,B,A] = dir2cas(bhp,ahp) 
C = 0.0243 


B = 1.0000 -2.0000 1.0000 
1.0000 -2.0000 1.0000 
A = 1.0000 1.0416 0.4019 


1.0000 0.5561 0.7647 


The system function of the highpass filter is 


0.0243(1 — 27+)* 


HG) (1 + 0.5661z-! + 0.7647z-2)(1 + 1.04162—! + 0.40192) 


which is essentially identical to that in Example 8.25. 


8.6.1 DESIGN PROCEDURE 

In Example 8.26 a lowpass prototype digital filter was available to trans- 
form into a highpass filter so that a particular band-edge frequency was 
properly mapped. In practice we have to first design a prototype lowpass 
digital filter whose specifications should be obtained from specifications 
of other frequency-selective filters as given in Figure 8.30. We will now 
show that the lowpass prototype filter specifications can be obtained from 
the transformation formulas given in Table 8.2. 

Let us use the highpass filter of Example 8.25 as an example. The 
passband-edge frequencies were transformed using the parameter a = 
—0.38197 in (8.70). What is the stopband-edge frequency of the highpass 
filter, say ws, corresponding to the stopband edge wi, = 0.37 of the pro- 
totype lowpass filter? This can be answered by (8.70). Since a is fixed for 
the transformation, we set the equation 


— cos((0.37 + ws) /2] 
= cos[(0.30 — ws) /2] ogar 


This is a transcendental equation whose solution can be obtained iter- 
atively from an initial guess. It can be done using MATLAB, and the 
solution is 


ws = 0.45867 
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Now in practice we will know the desired highpass frequencies w, and 
wp, and we are required to find the prototype lowpass cutoff frequencies 
w; and wp. We can choose the passband frequency w, with a reasonable 
value, say Wp = 0.27, and determine a from wp using the formula from 
Table 8.2. Now w/ can be determined (for our highpass filter example) 


from a and 


—JWs 
a= (E) (8.71) 


Continuing our highpass filter example, let wp = 0.67 and ws = 0.45867 be 
the band-edge frequencies. Let us choose wp = 0.27. Then a = —0.38197 
from (8.70), and from (8.71) 


-40.45867 _ 9 38197 
wes ( 3 ) = 0.37 


1 — 0.38197e—J— 0.38197 


as expected. Now we can design a digital lowpass filter and transform 
it into a highpass filter using the zmapping function to complete our 
design procedure. For designing a highpass Chebyshev-I digital filter, the 
above procedure can be incorporated into a MATLAB function called the 
cheb1hpf function shown here. 


function [b,a] = chebihpf (wp,ws,Rp,As) 

% IIR Highpass filter design using Chebyshev-1 prototype 
% function [b,a] = cheb1hpf(wp,ws,Rp,As) 

% b = Numerator polynomial of the highpass filter 

% a = Denominator polynomial of the highpass filter 
Passband frequency in radians 

% ws = Stopband frequency in radians 

Passband ripple in dB 

Stopband attenuation in dB 


E 


x x 
> 

a 
"ou 


% Determine the digital lowpass cutoff frequencies: 
wplp = 0.2*pi; 

alpha = -(cos((wplp+wp) /2))/(cos((wplp-wp) /2)) ; 

wslp = angle(-(exp(-j*ws)+alpha) /(1+alpha*xexp(-j*ws) )) ; 
hh 
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% Compute Analog lowpass Prototype Specifications: 
Tr = the J = A 

OmegaP = (2/T)*tan(wplp/2) ; 

OmegaS = (2/T)*tan(wslp/2) ; 


% Design Analog Chebyshev Prototype Lowpass Filter: 
[cs,ds] = afd_chb1(OmegaP,OmegaS ,Rp, As) ; 


% Perform Bilinear transformation to obtain digital lowpass 
[blp,alp] = bilinear(cs,ds,Fs) ; 


% Transform digital lowpass into highpass filter 


Nz = -[alpha,1]; Dz = [1,alpha]; 
[b,a] = zmapping(blp,alp,Nz,Dz) ; 


We will demonstrate this procedure in the following example. 


EXAMPLE 8.27 Design a highpass digital filter to satisfy 


Wp = 0.67, Rp = 1 dB 
ws = 0.45867, A, = 15 dB 


Use the Chebyshev-I prototype. 


Solution MATLAB script: 


>> /% Digital Highpass Filter Specifications: 


>> wp = 0.6*pi; % digital Passband freq in rad 
>> ws = 0.4586*pi; % digital Stopband freq in rad 
>> Rp = 1; % Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> [b,a] = chebihpf(wp,ws,Rp,As); [C,B,A] = dir2cas(b,a) 


C = 0.0243 

B = 1.0000 -2.0000 1.0000 
1.0000 -2.0000 1.0000 

A = 1.0000 1.0416 0.4019 
1.0000 0.5561 0.7647 


The system function is 


0.0243(1 — 27+)* 
(1 + 0.56612—! + 0.7647z-2)(1 + 1.041627! + 0.4019z-2) 


A(z) = 


which is identical to that in Example 8.26. 
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This highpass filter design procedure can be easily extended to other 
frequency-selective filters using the transformation functions in Table 8.2. 
These design procedures are explored in Problems P8.34, P8.36, P8.38, 
and P8.40. We now describe MATLAB’s filter design functions for design- 
ing arbitrary frequency-selective filters. 


8.6.2 MATLAB IMPLEMENTATION 

In the preceding section we discussed four MATLAB functions to design 
digital lowpass filters. These same functions can also be used to design 
highpass, bandpass, and bandstop filters. The frequency-band transfor- 
mations in these functions are done in the s-plane, that is, they use 
Approach-1 discussed on page 386. For the purpose of illustration we 
will use the function butter. It can be used with the following variations 
in its input arguments. 


e [b,a] = BUTTER(N,wn,’high’) designs an Nth-order highpass filter 
with digital 3-dB cutoff frequency wn in units of r. 

e [b,a] = BUTTER(N,wn,)designs an order 2N bandpass filter if wn is a 
two-element vector, wn=[w1 w2], with 3-dB passband wi < w < w2in 
units of 7. 

e [b,a] = BUTTER(N,wn, ’stop’) is an order 2N bandstop filter if wn=[w1 
w2] with 3-dB stopband w1 < w < w2 in units of 7r. 


To design any frequency-selective Butterworth filter, we need to know 
the order N and the 3-dB cutoff frequency vector wn. In this chapter we 
described how to determine these parameters for lowpass filters. However, 
these calculations are more complicated for bandpass and bandstop filters. 
In their SP toolbox, MATLAB provides a function called buttord to 
compute these parameters. Given the specifications, wp, ws, Rp, and As, 
this function determines the necessary parameters. Its syntax is 


[N,wn] = buttord(wp,ws,Rp,As) 


The parameters wp and ws have some restrictions, depending on the type 
of filter: 


For lowpass filters wp < ws. 
For highpass filters wp > ws. 
For bandpass filters wp and ws are two-element vectors, wp=[wp1, 
wp2] and ws=[ws1,ws2], such that ws1 < wpl < wp2 < ws2. 
e For bandstop filters wp1 < ws1 < ws2 < wp2. 


Now using the buttord function in conjunction with the butter func- 
tion, we can design any Butterworth IIR filter. Similar discussions apply 
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Solution 


>> 
>> 


>> 
>> 
>> 
>> 
>> 
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EXAMPLE 8.28 


EXAMPLE 8.29 


Chapter 8 m IIR FILTER DESIGN 


for cheby1, cheby2, and ellip functions with appropriate modifications. 
We illustrate the use of these functions through the following examples. 


were given in Example 8.27. 


MATLAB script: 


% Digital Filter Specifications: 


ws = 0.4586*pi; 


wp = 0.6*pi; 
Rp = 1; 
As = 15; 


hh 
h 
hh 
hh 
h 


In this example we will design a Chebyshev-I highpass filter whose specifications 


Type: Chebyshev-I highpass 
Dig. stopband edge frequency 
Dig. passband edge frequency 
Passband ripple in dB 
Stopband attenuation in dB 


% Calculations of Chebyshev-I Filter Parameters: 


(N,wn] = cheblord(wp/pi,ws/pi,Rp,As) ; 


% Digital Chebyshev-I Highpass Filter Design: 


[b,a] = cheby1(N,Rp,wn, ’high’) ; 


% Cascade Form Realization: 


[b0,B,A] = dir2cas(b, 
= 0.0243 
1.0000 19991 
1.0000 -2.0009 
1.0000 1.0416 
1.0000 0.5561 


The cascade form system function 


a) 


0.9991 
1.0009 
0.4019 
0.7647 


0.0243(1 — 27+)* 


A(z) = 


(1 + 0.5661z-! + 0.7647z-2)(1 + 1.04162-1 + 0.40192) 


is identical to the filter designed in Example 8.27, which demonstrates that 
the two approaches described on page 386 are identical. The frequency-domain 


plots are shown in Figure 8.32. 


% Digital Filter Specifications: 


ws = [0.3*pi 0.75*pi] 
wp = [0.4*pi 0.6*pil; 
Rp = 1; 
As 40; 


$ 


hh 
hh 
hh 
hh 
hh 


In this example we will design an elliptic bandpass filter whose specifications 
are given in the following MATLAB script: 


Type: Elliptic Bandpass 

Dig. stopband edge frequency 
Dig. passband edge frequency 
Passband ripple in dB 
Stopband attenuation in dB 
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FIGURE 8.32 Digital Chebyshev-I highpass filter in Example 8.28 


>> % Calculations of Elliptic Filter Parameters: 
>> [N,wn] = ellipord(wp/pi,ws/pi,Rp,As) ; 


>> % Digital Elliptic Bandpass Filter Design: 
>> [b,a] = ellip(N,Rp,As,wn); 


>> % Cascade Form Realization: 
>> [b0,B,A] = dir2cas(b,a) 
bO = 0.0197 


B = 1.0000 1.5066 1.0000 
1.0000 0.9268 1.0000 
1.0000 -0.9268 1.0000 
1.0000 -1.5066 1.0000 

A = 1.0000 0.5963 0.9399 
1.0000 0.2774 0.7929 
1.0000 -0.2774 0.7929 
1.0000 -0.5963 0.9399 


Note that the designed filter is a 10th-order filter. The frequency-domain plots 
are shown in Figure 8.33. 
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FIGURE 8.33 Digital elliptic bandpass filter in Example 8.29 


EXAMPLE 8.30 Finally, we will design a Chebyshev-II bandstop filter whose specifications are 
given in the following MATLAB script. 


>> % Digital Filter Specifications: % Type: Chebyshev-II Bandstop 
>> ws = [0.4*pi 0.7*pil; % Dig. stopband edge frequency 
>> wp = [0.25*pi 0.8*pi] ; % Dig. passband edge frequency 
>> Rp = 1; % Passband ripple in dB 

>> As = 40; % Stopband attenuation in dB 


>> % Calculations of Chebyshev-II Filter Parameters: 
>> [N,wn] = cheb2ord(wp/pi,ws/pi,Rp,As) ; 


>> % Digital Chebyshev-II Bandstop Filter Design: 
>> [b,a] = cheby2(N,As,ws/pi,’stop’) ; 


>> % Cascade Form Realization: 
>> [b0,B,A] = dir2cas(b,a) 
bO = 0.1558 


B = 1.0000 1.1456 1.0000 
1.0000 0.8879 1.0000 
1.0000 0.3511 1.0000 
1.0000 -0.2434 1.0000 
1.0000 -0.5768 1.0000 
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FIGURE 8.34 Digital Chebyshev-II bandstop filter in Example 8.30 


. 0000 1.3041 0.8031 
. 0000 0.8901 0.4614 
. 0000 0.2132 0.2145 
.0000 -0.4713 0.3916 
.0000 -0.8936 0.7602 


BPRPRPRPR 


This is also a 10th-order filter. The frequency domain plots are shown in 
Figure 8.34. 


8.7 PROBLEMS 
ee 


P8.1 A digital resonator is to be designed with wo = 7/4 that has 2 zeros at z = 0. 


1. Compute and plot the frequency response of this resonator for r = 0.8, 0.9, and 0.99. 

2. For each case in part 1, determine the 3 dB bandwidth and the resonant frequency wr 
from your magnitude plots. 

3. Check if your results in part 2 are in agreement with the theoretical results. 
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P8.2 A digital resonator is to be designed with wo = 7/4 that has 2 zeros at z = 1 and z = —1. 


1. Compute and plot the frequency response of this resonator for r = 0.8, 0.9, and 0.99. 

2. For each case in part 1 determine the 3 dB bandwidth and the resonant frequency wr 
from your magnitude plots. 

3. Compare your results in part 2 with (8.48) and (8.47 ), respectively. 


P8.3 We want to design a digital resonator with the following requirements: a 3 dB bandwidth of 
0.05 rad, a resonant frequency of 0.375 cycles/sam, and zeros at z = 1 and z = —1. Using 
trial-and-error approach, determine the difference equation of the resonator. 


P8.4 A notch filter is to be designed with a null at the frequency wo = 7/2. 


1. Compute and plot the frequency response of this notch filter for r = 0.7, 0.9, and 0.99. 

2. For each case in part 1, determine the 3 dB bandwidth from your magnitude plots. 

3. By trial-and-error approach, determine the value of r if we want the 3 dB bandwidth to 
be 0.04 radians at the null frequency wo = 1/2. 


P8.5 Repeat Problem P8.4 for a null at wo = 77/6. 


P8.6 A speech signal with bandwidth of 4 kHz is sampled at 8 kHz. The signal is corrupted by 
sinusoids with frequencies 1 kH, 2 kHz, and 3 kHz. 


1. Design an IIR filter using notch filter components that eliminates these sinusoidal 
signals. 

2. Choose the gain of the filter so that the maximum gain is equal to 1, and plot the 
log-magnitude response of your filter. 

3. Load the handel sound file in MATLAB, and add the preceding three sinusoidal signals 
to create a corrupted sound signal. Now filter the corrupted sound signal using your 
filter and comment on its performance. 


P8.7 Consider the system function of an IIR lowpass filter 


L+27t 


H(2) = Kgg 


(8.72) 


where K is a constant that can be adjusted to make the maximum gain response equal to 1. 
We obtain the system function of an Lth-order comb filter Hz (z) using Hz (z) = H(z"). 


1. Determine the value of K for the system function in (8.72). 

2. Using the K value from part 1, determine and plot the log-magnitude response of the 
comb filter for L = 6. 

3. Describe the shape of your plot in part 2. 


P8.8 Consider the system function of an IIR highpass filter 


1-271 


Ag) = ggg 


(8.73) 


where K is a constant that can be adjusted to make the maximum gain response equal to 1. 
We obtain the system function of an Lth-order comb filter Hz (z) using Hz (z) = H(z"). 
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1. Determine the value of K for the system function in (8.73). 

2. Using the K value from part 1, determine and plot the log-magnitude response of the 
comb filter for L = 6. 

3. Describe the shape of your plot in part 2. 


P8.9 (Adapted from [19]) As discussed in Chapter 1, echos and reverberations of a signal x(n) 
can be obtained by scaling and delaying, that is, 


y(n) = X apx(n — kD) (8.74) 
k=0 


where D is a positive integer for minimum delay and ax > &k-1ı > 0. 


1. Consider the IIR comb filter given by 


Haam (8.75) 


1—az-? 


Determine its impulse response. Explain why this filter can be used as a reverberator. 
2. Consider the cascade of three allpass comb filters 


Dı D D 


z“ 1 — a z“ 2 — ag z 3 — ag 


H(z) (8.76) 


~ 1— az? 5 1 — aoz 7 P2 A 1 — a3z—P3 
which can be used as a practical digital reverberator. Compute and plot the impulse 
response of this reverberator for Dı = 50, a1 = 0.7; Do = 41, a2 = 0.665; and D3 = 32, 
a3 = 0.63175. 

3. Repeat part 2 for Dı = 53, a1 = 0.7; D2 = 40, a2 = 0.665; and D3 = 31, a3 = 0.63175. 
How does the shape of this reverberator different from the one in part 2? Which is a 
good reverberator? 


P8.10 Consider the 1st-order allpass system function given by 
1 


H(z) = a+z 


The phase-delay of a system is defined as ®#(w) A —LH(e*) /w and is measured in samples. 


1. Show that the phase-delay of the system in (8.77) at low frequencies is given by 


_il-a 
~ l+a 


(w) fraza 1 (8.78) 

2. Plot the phase-delay over —7/2 < w < 1/2 for a = 0.9, 0.95, and 0.99 to verify 
Problem P8.10. Comment on the accuracy of the results. 

3. Design a 1st-order allpass system that has phase delay of 0.01 samples. Plot its 
magnitude and phase-delay responses. 


P8.11 Consider the second-order allpass system function given by 


ag + ayz + z7? 


H et 
(2) 1 +aız7! + a2z72 


(8.79) 
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The phase-delay of a system is defined as ®(w) A —/H (e) /w and is measured in samples. 


It can be shown that if we choose 


yeaa _ 2-d(-d) 
A = (5) ee aden (8.80) 


Then phase-delay ®(w) at low frequencies is approximated by d in samples. Verify this 

result by plotting P(w) over —r/2 < w < 7/2 for d= 0.1, d= 0.05, and d = 0.01. 
P8.12 Design an analog Butterworth lowpass filter that has a 0.25 dB or better ripple at 

500 rad/sec and at least 50 dB of attenuation at 2000 rad/sec. Determine the system 

function in a rational function form. Plot the magnitude response, the log-magnitude 

response in dB, the phase response, and the impulse response of the filter. 


P8.13 Design an analog Butterworth lowpass filter that has a 0.5 dB or better ripple at 10 kHz 
and at least 45 dB of attenuation at 20 kHz. Determine the system function in a cascade 
form. Plot the magnitude response, the log-magnitude response in dB, the group-delay, and 
the impulse response of the filter. 


P8.14 Design a lowpass analog Chebyshev-I filter with an acceptable ripple of 1 dB for |Q| < 10 
and an attenuation of 50 dB or greater beyond |Q| = 15 rad/sec. Determine the system 
function in a rational function form. Plot the magnitude response, the log-magnitude 
response in dB, the group-delay, and the impulse response of the filter. 


P8.15 Design a lowpass analog Chebyshev-I filter with the following characteristics: 


e A passband ripple of 0.5 dB, 
e passband cutoff frequency of 4 kHz, and 
e stopband attenuation of 45 dB or greater beyond 20 kHz. 


Determine the system function in a cascade form. Plot the magnitude response, the 
log-magnitude response in dB, the phase response, and the impulse response of the filter. 


P8.16 A signal x,(t) contains two frequencies, 10 kHz and 15 kHz. We want to suppress the 
15 kHz component to 50 dB attenuation while passing the 10 kHz component with less than 
0.25 dB attenuation. Design a minimum-order Chebyshev-II analog filter to perform this 
filtering operation. Plot the log-magnitude response, and verify the design. 


P8.17 Design an analog Chebyshev-II lowpass filter that has a 0.25 dB or better ripple at 250 Hz 
and at least 40 dB of attenuation at 400 Hz. Plot the magnitude response, the 
log-magnitude response in dB, the group-delay, and the impulse response of the filter. 


P8.18 A signal za(t) contains two frequencies, 10 kHz and 15 kHz. We want to suppress the 
15 kHz component to 50 dB attenuation while passing the 10 kHz component with less than 
0.25 dB attenuation. Design a minimum-order elliptic analog filter to perform this filtering 
operation. Plot the log-magnitude response and verify the design. Compare your design 
with the Chebyshev-II design in Problem P8.16. 


P8.19 Design an analog elliptic lowpass filter that has a 0.25 dB or better ripple at 500 rad/sec 
and at least 50 dB of attenuation at 2000 rad/sec. Determine the system function in a 
rational function form. Plot the magnitude response, the log-magnitude response in dB, the 
phase response, and the impulse response of the filter. Compare your design with the 
Butterworth design in Problem P8.12. 


P8.20 Write a MATLAB function to design analog lowpass filters. The format of this function 
should be 
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function [b,a] =afd(type,Fp,Fs,Rp,As) 

% 

% function [b,a] =afd(type,Fp,Fs,Rp,As) 

% Designs analog lowpass filters 

% type = ’butter’ or ’cheby1’ or ’cheby2’ or ’ellip’ 
% Fp = passband cutoff in Hz 

% Fs = stopband cutoff in Hz 

% Rp = passband ripple in dB 

% As = stopband attenuation in dB 


Use the afd_butt, afd_chb1, afd_chb2, and afd_elip functions developed in this chapter. 
Check your function using specifications given in Problems P8.12 through P8.17. 


P8.21 We want to design a Chebyshev-I prototype lowpass digital filter operating at a sampling 
rate of 8 kHz with a passband edge of 3.2 kHz, a passband ripple of 0.5 dB, and a minimum 
stopband attenuation of 45 dB at 3.8 kHz. 


1. Using the impulse invariance transformation with T = 1 sec, design the digital filter. Plot 
the magnitude and the log-magnitude responses as functions of analog frequency in kHz. 

2. Repeat part 1 using T = 1/8000 sec. 

3. Compare the above two designs in parts 1 and 2 in terms of their frequency responses. 
Comment on the effect of T on the impulse invariance design. 


P8.22 Design a Butterworth digital lowpass filter to satisfy the specifications: 


passband edge: 0.47, Rp =0.5 dB 
stopband edge: 0.67, As = 50 dB 


Use the impulse invariance method with T = 2. Determine the system function in the 
rational form, and plot the log-magnitude response in dB. Plot the impulse response h(n) 
and the impulse response ha(t) of the analog prototype and compare their shapes. 


P8.23 Write a MATLAB function to design digital lowpass filters based on the impulse invariance 
transformation. The format of this function should be 


function [b,a] =dlpfd_ii(type,wp,ws,Rp,As,T) 

% 

% function [b,a] =dlpfd_ii(type,wp,ws,Rp,As,T) 

% Designs digital lowpass filters using impulse invariance 
% type = ’butter’ or ’cheby1’ 

% wp = passband cutoff in Hz 

% ws = stopband cutoff in Hz 

% Rp = passband ripple in dB 

% As = stopband attenuation in dB 

ih T = sampling interval 


Use the afd function developed in Problem P8.20. Check your function on specifications 
given in Problems P8.21 and P8.22. 
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P8.24 In this problem we will develop a technique called the step invariance transformation. In 
this technique, the step response of an analog prototype filter is preserved in the resulting 
digital filter; i.e., if va(t) is the step response of the prototype and if v(n) is the step 
response of the digital filter, then 


u(n) = va(t)|,-,7, T : sampling interval 


Note that the frequency-domain quantities are related by 


4 


Va(s) = £[va(t)] = Ha(s)/s 


and 


A 1 


V2) Ê Z [o(n)] = He) 


Hence the step invariance transformation steps are: Given Ha(s8) 


divide Ha(s) by s to obtain Va(s), 

find residues {Rx} and poles {px} of Va(s), 

transform analog poles {px} into digital poles erent where T is arbitrary, 
e determine V (z) from residues {Rx} and poles {erst and finally 


e determine H(z) by multiplying V(z) by (1 — a) 


Use the above procedure to develop a MATLAB function to implement the step invariance 
transformation. The format of this function should be 


function [b,a] =stp_invr(c,d,T) 

% Step Invariance Transformation from Analog to Digital Filter 
% [b,a] =stp_invr(c,d,T) 

% b = Numerator polynomial in z~(-1) of the digital filter 

a Denominator polynomial in z^(-1) of the digital filter 
Ma Numerator polynomial in s of the analog filter 

ih Denominator polynomial in s of the analog filter 

h Sampling (transformation) parameter 


Hao mp 
ou ow 


P8.25 Design the lowpass Butterworth digital filter of Problem P8.22 using the step invariance 
method. Plot the log-magnitude response in dB and compare it with that in Problem P8.22. 
Plot the step response v(n) and the impulse response v,(t) of the analog prototype and 
compare their shapes. 


P8.26 In this chapter we discussed a filter transformation technique called the matched-z 
transformation. Using (8.69) write a MATLAB function called mzt that maps the analog 
system function Ha(s) into the digital system function H(z). The format of the function 
should be 
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function [b,a] = mzt(c,d,T) 

% Matched-Z Transformation from Analog to Digital Filter 

% [b,a] = MZT(c,d,T) 

% b = Numerator polynomial in z~(-1) of the digital filter 
7h = Denominator polynomial in z^°(-1) of the digital filter 
h Numerator polynomial in s of the analog filter 

ib Denominator polynomial in s of the analog filter 

i Sampling interval (transformation parameter) 


Haa DY 
ou 


Using this function, transform 


s+1 

A,(s) = ——— 
Oar vere Perey: 

into a digital filter H(z) for the sampling intervals (in seconds): T = 0.05, T = 0.1, and 

T = 0.2. In each case obtain a plot similar to that in Figure 8.20 and comment on the 

performance of this technique. 


P8.27 Consider an analog Butterworth lowpass filter that has a 1 dB or better ripple at 100 Hz 
and at least 30 dB of attenuation at 150 Hz. Transform this filter into a digital filter using 
the matched-z transformation technique in which Fs = 1000 Hz. Plot the magnitude and 
phase response of the resulting digital filter and determine the exact band-edge frequencies 
for the given dB specifications. Comment on the results. 


P8.28 Consider an analog Chebyshev-I lowpass filter that has a 0.5 dB or better ripple at 500 Hz 
and at least 40 dB of attenuation at 700 Hz. Transform this filter into a digital filter using 
the matched-z transformation technique in which Fs = 2000 Hz. Plot the magnitude and 
phase response of the resulting digital filter and determine the exact band-edge frequencies 
for the given dB specifications. Comment on the results. 


P8.29 Consider an analog Chebyshey-II lowpass filter that has a 0.25 dB or better ripple at 
1500 Hz and at least 80 dB of attenuation at 2000 Hz. Transform this filter into a digital 
filter using the matched-z transformation technique in which Fs = 8000 Hz. Plot the 
magnitude and phase response of the resulting digital filter, and determine the exact 
band-edge frequencies for the given dB specifications. Comment on the results. Is this a 
satisfactory design? 


P8.30 Consider the design of the lowpass Butterworth filter of Problem P8.22. 


1. Use the bilinear transformation technique outlined in this chapter and the bilinear 
function. Plot the log-magnitude response in dB. Compare the impulse responses of the 
analog prototype and the digital filter. 

2. Use the butter function and compare this design with the one in part 1. 


P8.31 Consider the design of the digital Chebyshev-1 filter of Problem P8.21. 


1. Use the bilinear transformation technique outlined in this chapter and the bilinear 
function. Plot the log-magnitude response in dB. Compare the impulse responses of the 
analog prototype and the digital filter. 

2. Use the cheby1 function and compare this design with the one above. 
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P8.32 Design a digital lowpass filter using elliptic prototype to satisfy the requirements: 
passband edge: 0.37, Rp = 0.25 dB 
stopband edge: 0.47, As = 50 dB 


Use the bilinear as well as the ellip function and compare your designs. 


P8.33 Design a digital lowpass filter to satisfy the specifications: 
passband edge: 0.457, Rp = 0.5 dB 
stopband edge: 0.57, As = 60 dB 


1. Use the butter function and determine the order N and the actual minimum stopband 
attenuation in dB. 

2. Use the cheby1 function and determine the order N and the actual minimum stopband 
attenuation in dB. 

3. Use the cheby2 function and determine the order N and the actual minimum stopband 
attenuation in dB. 

4. Use the ellip function and determine the order N and the actual minimum stopband 
attenuation in dB. 

5. Compare the orders, the actual minimum stopband attenuations, and the group delays 
in each of the above designs. 


P8.34 Write a MATLAB function to determine the lowpass prototype digital filter frequencies 
from an highpass digital filter specifications using the procedure outlined in this chapter. 
The format of this function should be 


function [wpLP,wsLP,alpha] = hp2lpfre(wphp,wshp) 

% Band-edge frequency conversion from highpass to lowpass digital filter 
% [wpLP,wsLP,a] = hp21pfre(wphp,wshp) 

4% wpLP = passband egde for the lowpass prototype 


% wsLP = stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 
4% wphp = passband egde for the highpass 

% wshp = stopband egde for the highpass 


Using this function develop a MATLAB function to design a highpass digital filter using the 
bilinear transformation. The format of this function should be 


function [b,a] = dhpfd_bl(type,wp,ws,Rp,As) 

% IIR Highpass filter design using bilinear transformation 
% [b,a] = dhpfd_bl(type,wp,ws,Rp,As) 

% type = ’butter’ or ’cheby1’ or ’chevy2’ or ’ellip’ 


a b = Numerator polynomial of the highpass filter 
tb a = Denominator polynomial of the highpass filter 
% wp = Passband frequency in radians 

% ws = Stopband frequency in radians (wp < ws) 

% Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


Verify your function using the specifications in Example 8.27. 
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P8.35 Design a highpass filter to satisfy the specifications: 


stopband edge: 0.47, As = 60 dB 
passband edge: 0.67, Rp = 0.5 dB 


1. Use the dhpfd_bl function of Problem P8.34 and the Chebyshev-I prototype to design 
this filter. Plot the log-magnitude response in dB of the designed filter. 

2. Use the cheby1 function for design and plot the log-magnitude response in dB. Compare 
these two designs. 


P8.36 Write a MATLAB function to determine the lowpass prototype digital filter frequencies 
from an arbitrary lowpass digital filter specifications using the functions given in Table 8.2 
and the procedure outlined for highpass filters. The format of this function should be 


function [wpLP,wsLP,alpha] = lp2lpfre(wplp,wslp) 

% Band-edge frequency conversion from lowpass to lowpass digital filter 
% [wpLP,wsLP,a] = 1p2lpfre(wplp,wslp) 

% wpLP = passband egde for the lowpass prototype 

% wsLP stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

4% wplp = passband egde for the given lowpass 

% wslp = passband egde for the given lowpass 


Using this function, develop a MATLAB function to design a lowpass filter from a 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dlpfd_bl(type,wp,ws,Rp,As) 

% IIR lowpass filter design using bilinear transformation 
% [b,a] = dlpfd_bl(type,wp,ws,Rp,As) 

% type = ’butter’ or ’cheby1’ or ’chevy2’ or ’ellip’ 

h b = Numerator polynomial of the bandpass filter 

% a = Denominator polynomial of the bandpass filter 

% wp = Passband frequency in radians 

4 ws = Stopband frequency in radians 

% Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


Verify your function using the designs in Problem P8.33. 
P8.37 Design a bandpass digital filter using the Cheby2 function. The specifications are: 


lower stopband edge: 0.37 
upper stopband edge: 0.67 
lower passband edge: 0.47 
upper passband edge: 0.57 


As = 50 dB 


Rp = 0.5 dB 


Plot the impulse response and the log-magnitude response in dB of the designed filter. 


P8.38 Write a MATLAB function to determine the lowpass prototype digital filter frequencies 
from a bandpass digital filter specifications using the functions given in Table 8.2 and the 
procedure outlined for highpass filters. The format of this function should be 
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function [wpLP,wsLP,alpha] = bp2lpfre(wpbp,wsblp) 

% Band-edge frequency conversion from bandpass to lowpass digital filter 

/% [wpLP,wsLP,a] = bp2lpfre(wpbp,wsbp) 

% wpLP = passband egde for the lowpass prototype 

% wsLP stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wpbp = passband egde frequency array [wp_lower, wp_upper] for the bandpass 
% wsbp = passband egde frequency array [ws_lower, ws_upper] for the bandpass 


Using this function, develop a MATLAB function to design a bandpass filter from a 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dbpfd_bl(type,wp,ws,Rp,As) 

% IIR bandpass filter design using bilinear transformation 

% [b,a] = dbpfd_bl(type,wp,ws,Rp,As) 

% type = ’butter’ or ’cheby1’ or ’chevy2’ or ’ellip’ 

h b = Numerator polynomial of the bandpass filter 

h a = Denominator polynomial of the bandpass filter 

% wp = Passband frequency array [wp_lower, wp_upper] in radians 
4 ws = Stopband frequency array [wp_lower, wp_upper] in radians 
% Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


Verify your function using the design in Problem P8.37. 


P8.39 We wish to use the Chebyshev-I prototype to design a bandstop digital IIR filter that meets 
the following specifications: 


0.95 < |H(e%”)| < 1.05, 0 < |w| < 0.257 
0 < |H(e%”)| < 0.01, 0.357 < |w| < 0.657 
0.95 < |H(e%”)| < 1.05, 0.757 < lw] < 7 


Use the cheby1 function and determine the system function H(z) of such a filter. Provide a 
plot containing subplots of the log-magnitude response in dB and the impulse response. 


P8.40 Write a MATLAB function to determine the lowpass prototype digital filter frequencies 
from a bandstop digital filter specifications using the functions given in Table 8.2 and the 
procedure outlined for highpass filters. The format of this function should be 


function [wpLP,wsLP,alpha] = bs2lpfre(wpbp,wsblp) 

% Band-edge frequency conversion from bandstop to lowpass digital filter 

% [wpLP,wsLP,a] = bs2lpfre(wpbp,wsbp) 

% wpLP = passband egde for the lowpass prototype 

% wsLP stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wpbp = passband egde frequency array [wp_lower, wp_upper] for the bandstop 
% wsbp = passband egde frequency array [ws_lower, ws_upper] for the bandstop 
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Using this function, develop a MATLAB function to design a bandstop filter from a 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dbsfd_bl(type,wp,ws,Rp,As) 

% IIR bandstop filter design using bilinear transformation 

% [b,a] = dbsfd_bl(type,wp,ws,Rp,As) 

% type = ’butter’ or ’cheby1’ or ’chevy2’ or ’ellip’ 

h b = Numerator polynomial of the bandstop filter 

h a = Denominator polynomial of the bandstop filter 

% wp = Passband frequency array [wp_lower, wp_upper] in radians 
4 ws = Stopband frequency array [wp_lower, wp_upper] in radians 
% Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


Verify your function using the design in Problem P8.39. 
P8.41 An analog signal 


Talt) = 3sin(40rt) + 3 cos(50rt) 


is to be processed by a 


zalt) — | A/D | 4 | H(z) |— | D/A | — yalt) 


system in which the sampling frequency is 100 sam/sec 


1. Design a minimum order IIR digital filter that will pass the first component of za(t) 
with attenuation of less than 1 dB and suppress the second component to at least 50 dB. 
The filter should have a monotone passband and an equiripple stopband. Determine the 
system function in rational function form and plot the log-magnitude response. 

2. Generate 500 samples (sampled at 100 sam/sec) of the signal £a(t) and process through 
the designed filter to obtain the output sequence. Interpolate this sequence (using any 
one of the interpolating techniques discussed in Chapter 3) to obtain ya(t). Plot the 
input and the output signals and comment on your results. 


P8.42 Using the bilinear transformation method, design a 10th-order elliptic bandstop filter to 
remove the digital frequency w = 0.447 with bandwidth of 0.087. Choose a reasonable value 
for the stopband attenuation. Plot the magnitude response. Generate 201 samples of the 
sequence 


x(n) = sin [0.44rn], n=0,...,200 


and process thorough the bandstop filter. Comment on your results. 


P8.43 Design a digital highpass filter H(z) to be used in a 


zalt) [A/D] —[H(2)] [D/A | — yalt) 
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structure to satisfy the following requirements: 


e sampling rate of 10 Khz 

stopband edge of 1.5 Khz with attenuation of 40 dB 
passband edge of 2 Khz with ripple of 1dB 
equiripple passband and stopband 

bilinear transformation method 


1. Plot the magnitude response of the overall analog filter over the [0,5 Khz] interval. 

2. Plot the magnitude response of the digital lowpass prototype. 

3. What limitations must be placed on the input signals so that the preceding structure 
truly acts as a highpass filter to them? 


P8.44 The filter specifications shown in Figure P8.1 can be considered a combination of a 
bandpass and a highpass specifications. Design a minimum-order IIR digital filter to satisfy 
these specifications. Provide a plot of the magnitude response with grid-lines as shown in 
Figure P8.1. From your design and plot determine the order of the filter and the exact 
band-edge frequencies. 


P8.45 The filter specifications shown in Figure P8.2 can be considered as a combination of a 
lowpass and a bandpass specifications. Design a minimum-order IIR digital filter to satisfy 
these specifications. Provide a plot of the magnitude response with grid-lines as shown in 
Figure P8.2. From your design and plot determine the order of the filter and the exact 
band-edge frequencies. 


P8.46 Design a minimum-order IIR digital filter to satisfy the following specifications: 


e a passband over the [0.357, 0.57] interval 
e stopbands over the [0, 0.37] and [0.67, 7] intervals 


IH (e!)| 


EQUIRIPPLE 


EQUIRIPPLE 


0.45 


MONOTONE : 


als 


0 0.1 0.2 0.5 0.6 0.7 0.8 1 


FIGURE P8.1 Filter specifications for Problem P8.44 
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FIGURE P8.2 Filter specifications for Problem P8.45 


e passband ripple of 1 dB 
e stopband attenuation of 40 db 
e equiripple passbands and stopband 


Determine the system function H(z) of the designed filter in the rational function form. 
Provide a plot of the log-magnitude response in dB. From your design and plot, answer the 
following questions: 


1. What is the order of the filter? 

2. From your plot what are the exact band-edge frequencies for the given passband and 
stopband attenuations? 

3. Why is there a discrepancy between the specification frequencies and the exact 
frequencies? 
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CHAPTER 


Sampling Rate 
Conversion 


In many practical applications of digital signal processing, one is faced 
with the problem of changing the sampling rate of a signal, either increas- 
ing it or decreasing it by some amount. The process of converting a signal 
from a given rate to a different rate is called sampling rate conversion. 
In turn, systems that employ multiple sampling rates in the processing 
of digital signals are called multirate digital signal processing systems. In 
this chapter we describe sampling rate conversion and multirate signal 
processing in the digital domain. 

As an example, consider the system shown in Figure 9.1 in which 
an analog signal z(t) is sampled using the sampling rate of Fs = + 
samples/second. The resulting digital signal x(n) is subsequently filtered 
using a lowpass filter (LPF) with a cutoff frequency of we. 

Thus, the output signal y(n) has all its energy in the band 0 < w < 
we = 27 fe. According to the sampling theorem, such a signal may be rep- 
resented by the rate of 2f./T samples/second instead of its existing rate 
of F; = 1/T. Note that | f.| < 0.5. However, if fe < 0.5, then 2f./T « Fy. 
Hence it would seem more advantageous to lower the sampling frequency 
to a value closer to 2fe/T and perform signal processing operations at 
this lower rate. 

Other applications include the need for an optimal interpolation in 
computer tomography and efficient multistage designs of narrowband low- 
pass filters. 


474 
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FIGURE 9.1 A typical signal processing system 


9.1 INTRODUCTION 
—— g 


The idea of interpolation is a very familiar concept to most of us and has 
its origin in numerical analysis. Typically, interpolation is performed on a 
table of numbers representing a mathematical function. Such a table may 
be printed in a handbook or stored in a computer memory device. The 
interpolation, often simply linear (or straight line) approximation, cre- 
ates an error called the interpolation error. The main difference between 
interpolation in digital signal processing and interpolation in numerical 
analysis is that we will assume that the given data is bandlimited to some 
band of frequencies and develop schemes that are optimal on this ba- 
sis, whereas a numerical analyst typically assumes that the data consists 
of samples of polynomials (or very nearly so) and develops schemes to 
minimize the resulting error. 

To motivate this concept of interpolation in signal processing, it is 
helpful to think of an underlying (or original) analog signal x,(t) that 
was sampled to produce the given discrete signal x(n). If the xa(t) was 
sampled at the minimum required rate, then, according to the sampling 
theorem, it can be recovered completely from the samples x(n). If we now 
sample this recovered analog signal, at say twice the old rate, we have 
succeeded in doubling the sampling rate or interpolating by a factor of 2 
with zero interpolation error. Specifically, we have: 


Original discrete signal: a(n) = x,(nT) (9.1) 


sin[r(t — kT) /T] 


mtaaryT | |!) 


Reconstructed analog signal: a(t) = X y zalkT) 
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Resampled analog signal: £a (mz) =S a,(kT) sin [7 ( 7 )/T] 
k 2 
= 5 sana EU (9.3) 


resulting in high-rate discrete signal: y(m)Êza (mz) (9.4) 
In this formulation of ideal interpolation, the discrete signal was converted 
to the analog signal and then back to the discrete signal at twice the rate. 
In the subsequent sections we will study how to avoid this roundabout 
approach and perform sampling rate conversion completely in the digital 
domain. 

The process of sampling rate conversion in the digital domain can 
be viewed as a linear filtering operation, as illustrated in Figure 9.2a. 
The input signal x(n) is characterized by the sampling rate Fy = 1/Tz, 
and the output signal y(m) is characterized by the sampling rate F} = 
1/Ty, where Ty and Ty are the corresponding sampling intervals. In our 
treatment, the ratio F,,/F, is constrained to be rational 


ah ae ee (9.5) 


where D and I are relatively prime integers. We shall show that the 
linear filter is characterized by a time-variant impulse response, denoted 


y(m+3) yim+4) 
(b) 


FIGURE 9.2 Sampling rate conversion viewed as a linear filtering process 
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as h(n, m). Hence the input x(n) and the output y(m) are related by the 
superposition summation for time-variant systems. 

The sampling rate conversion process can also be understood from the 
point of view of digital resampling of the same analog signal. Let x(t) 
be the analog signal that is sampled at the first rate Fy to generate x(n). 
The goal of rate conversion is to obtain another sequence y(m) directly 
from a(n), which is equal to the sampled values of x,(t) at a second rate 
Fy. As is depicted in Figure 9.2b, y(m) is a time-shifted version of x(n). 
Such a time shift can be realized by using a linear filter that has a flat 
magnitude response and a linear phase response (i.e., it has a frequency 
response of e~ “7, where 7; is the time delay generated by the filter). If 
the two sampling rates are not equal, the required amount of time shifting 
will vary from sample to sample, as shown in Figure 9.2b. Thus, the rate 
converter can be implemented using a set of linear filters that have the 
same flat magnitude response but generate different time delays. 

Before considering the general case of sampling rate conversion, we 
shall consider two special cases. One is the case of sampling rate reduction 
by an integer factor D, and the second is the case of a sampling rate 
increase by an integer factor I. The process of reducing the sampling rate 
by a factor D (downsampling by D) is called decimation. The process of 
increasing the sampling rate by an integer factor J (upsampling by J) is 
called interpolation. 


9.2 DECIMATION BY A FACTOR D 
eee eee 


The basic operation required in decimation is the downsampling of the 
high-rate signal x(n) into a low-rate signal y(m). We will develop the 
time- and frequency-domain relationships between these two signals to 
understand the frequency-domain aliasing in y(m). We will then study 
the condition needed for error-free decimation and the system structure 
required for its implementation. 


9.2.1 THE DOWNSAMPLER 

Note that the downsampled signal y(m) is obtained by selecting one out 
of D samples of x(n) and throwing away the other (D — 1) samples out 
of every D samples—i.e., 


y(m) = 2(n)|,-mp = (mD); n,m, D € {integers} (9.6) 


The block diagram representation of (9.6) is shown in Figure 9.3. This 
downsampling element changes the rate of processing and thus is funda- 
mentally different from other block diagram elements that we have used 
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x(n) LD y(m) 
Rate F Rate F, =— 
x y D 


mn 


FIGURE 9.3 A downsampling element 


previously. In fact, we can show that a system containing a downsam- 
pling element is shift varying. However, this fact does not prohibit the 
frequency-domain analysis of y(m) in terms of x(n) as we shall see later. 


EXAMPLE 9.1 Using D = 2 and x(n) = {1,2,3,4,3,2,1} verify that the downsampler is time 
T 


varying. 


Solution The downsampled signal is y(m) = {1,3,3,1}. If we now delay x(n) by one 
T 


sample, we get x(n — 1) = {0, 1, 2, 3, 4,3,2, 1}. The corresponding downsampled 


; 
signal is yi(m) = {0, 2,4, 2}, which is different from y(m — 1). 
T 


MATLAB Implementation MATLAB provides the function [y] = 
downsample(x,D) that downsamples input array x into output array y 
by keeping every D-th sample starting with the first sample. An optional 
third parameter “phase” specifies the sample offset which must be an 
integer between 0 and (D-1). For example, 


>> x = [1,2,3,4,3,2,1]; y = downsample(x,2) 


y= 
1 3 3 1 


downsamples by a factor of 2 starting with the first sample. However, 


>> x = [1,2,3,4,3,2,1]; y = downsample(x,2,1) 


y = 
2 4 2 


produces an entirely different sequence by downsampling, starting with 
the second sample (i.e., offset by 1). 


The frequency-domain representation of the downsampled sig- 
nal y(m) We now express Y(w) in terms of X(w) using z-transform 
relations. Toward this we introduce a high-rate sequence %(n), which is 
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given by 


(9.7) 


a | a(n), n=0,+D,+2D,... 
~ 710, elsewhere 


Clearly, Z(n) can be viewed as a sequence obtained by multiplying «(n) 
with a periodic train of impulses p(n), with period D, as illustrated in 
Figure 9.4. The discrete Fourier series representation of p(n) is 


Af lp RS OSD ID, R a 
PY) = 0, elsewhere. D m : 8) 
Hence we can write 
T(n) = x(n)p(n) (9.9) 
and 
y(m) = &(mD) = «(mD)p(mD) = z(mD) (9.10) 


= 
N 
(oe) 
A 
oa 
N 
(oo) 
o 


y(m) | 
(a) ; m 


-3 -2 -1 0 1 3 


FIGURE 9.4 Operation of downsampling: (a) original signal x(n), (b) periodic 
impulse train p(n) with period D = 3, (c) multiplication of x(n) with p(n), and 
(d) downsampled signal y(n) 
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as shown in (9.6). Figure 9.4 shows an example of sequences x(n), £(n), 
and y(m) defined in (9.7)—(9.10). 
Now the z-transform of the output sequence y(m) is 


Y(z) = 5 y(m)z7™ = `e E(mD)z~™ 
7 (9.11) 
Y(e)= es) P 


where the last step follows from the fact that z(m) = 0, except at multi- 
ples of D. By making use of the relations in (9.7) and (9.8) in (9.11), we 


obtain 
co 1 D-1 
Y(z) = 5 a(m) È Xo sammo] gom/D 
m=—oo k=0 
D-1 


0 m=—co 
1 Dat 
= Ke) (9.12) 
k=0 


The key steps in obtaining the z-transform representation (9.12), for the 
(D | 1) downsampler, are as follows: 


e the introduction of the high-rate sequence %(n), which has (D—1) zeros 
in between the retained values x(nD), and 

e the impulse-train representation (9.8) for the periodic sampling series 
that relates x(n) to Z(n). 


By evaluating Y(z) on the unit circle, we obtain the spectrum of the 
output signal y(m). Since the rate of y(m) is Fy = 1/Ty, the frequency 
variable, which we denote as wy, is in radians and is relative to the sam- 
pling rate Fy, 


Qn F 
wy = Z =2nFT, (9.13) 
y 
Since the sampling rates are related by the expression 
F, 
F, = = 9.14 


it follows that the frequency variables wy and 


2 2r F 


x 


2r FT, (9.15) 


Wey 
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IX(a,)| 


=m -7/3 0 1/3 m 


H > 
-3m -27 S 0 m 27 3m F 
FIGURE 9.5 Spectra of x(n) and y(m) in no-aliasing case 
are related by 
wy = Dw, (9.16) 


Thus, as expected, the frequency range 0 < |w,| < T/D is stretched into 
the corresponding frequency range 0 < |w,| < m by the downsampling 
process. 

We conclude that the spectrum Y (wy), which is obtained by evaluat- 
ing (9.12) on the unit circle, can be expressed as! 


vey Sx (255) (9.17) 


which is an aliased version of the spectrum X (wg) of x(n). To avoid alias- 
ing error, one needs the spectrum X (ws) to be less than full band or 
bandlimited (note that this bandlimitedness is in the digital frequency 
domain). In fact we must have 


X(ws)=0 for 5 < wsl <T (9.18) 
Then, 
Vij x (=) lw, | <7 (9.19) 
D DAES 
and no aliasing error is present. An example of this for D = 3 is shown in 
Figure 9.5. 


lIn this chapter, we will make a slight change in our notation for the DTFT. We will use 
X (w) to denote the spectrum of x(n) instead of the previously used notation X(e/”). 
Although this change does conflict with the z-transform notation, the meaning should 
be clear from the context. This change is made for the sake of clarity and visibility of 
variables. 
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Comments: 


1. The sampling theorem interpretation for (9.19) is that the sequence 
x(n) was originally sampled at D times higher rate than required; 
therefore, downsampling by D simply reduces the effective sampling 
rate to the minimum required to prevent aliasing. 

2. Equation (9.18) expresses the requirement for zero decimation error 
in the sense that no information is lost—i.e., there is no irreversible 
aliasing error in the frequency domain. 

3. The argument oe occurs because in our notation w is expressed in 
rad/sample. Thus the frequency of y(m) expressed in terms of the 
higher-rate sequence x(n) must be divided by D to account for the 
slower rate of y(m). 

4. Note that there is a factor $ in (9.19). This factor is required to make 
the inverse Fourier transform work out properly and is entirely consis- 
tent with the spectra of the sampled analog signals. 


9.2.2 THE IDEAL DECIMATOR 
In general, (9.18) will not be exactly true, and the (D | 1) downsampler 
would cause irreversible aliasing error. To avoid aliasing, we must first 
reduce the bandwidth of x(n) to Fe max = Fr/2D or, equivalently, to 
We max = T/D. Then we may downsample by D and thus avoid aliasing. 
The decimation process is illustrated in Figure 9.6. The input se- 
quence x(n) is passed through a lowpass filter, characterized by the 
impulse response h(n) and a frequency response Hp(w.), which ideally 
satisfies the condition 


1, |we| < 2/D 


0, otherwise 


(9.20) 


Thus, the filter eliminates the spectrum of X (wr) in the range 7/D < 
Wg < T. Of course, the implication is that only the frequency components 
of x(n) in the range |w,| < m/D are of interest in further processing of 
the signal. 


Rate: F, ! Fg 


FIGURE 9.6 Ideal decimation by a factor D 
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The output of the filter is a sequence v(n) given as 


I> 


v(n) EX h(k)a(n — k) (9.21) 


k=0 
which is then downsampled by the factor D to produce y(m). Thus, 


y(m) = v(mD) = X` h(k)a(mD — k) (9.22) 
k 


=0 


Although the filtering operation on x(n) is linear and time invariant, the 
downsampling operation in combination with the filtering results also in 
a time-variant system. 

The frequency-domain characteristics of the output sequence y(m) ob- 
tained through the filtered signal v(n) can be determined by following the 
analysis steps given before—i.e., by relating the spectrum of y(m) to the 
spectrum of the input sequence x(n). Using these steps, we can show that 


D-1 
1 
MO) Dy Hee na) Mle ee a) (9.23) 
k=0 
or that > 
—1 
1 Wy — 27k Wy — 27k 
Y z H| = |) x | SS 24 
w= 5 LH (AS) x(a) (9.24) 


With a properly designed filter Hp(w), the aliasing is eliminated and, 
consequently, all but the first term in (9.24) vanish. Hence, 


ven- pm (B)x C$) -5x (4) em 


for 0 < |wy| < a. The spectra for the sequences x(n), h(n), v(n), and 
y(m) are illustrated in Figure 9.7. 


MATLAB Implementation MATLAB provides the function y = 
decimate(x,D) that resamples the sequence in array x at 1/D times 
the original sampling rate. The resulting resampled array y is D times 
shorter—i.e., length(y) = length(x)/D. An ideal lowpass filter given 
in (9.20) is not possible in the MATLAB implementation; however, fairly 
accurate approximations are used. The default lowpass filter used in the 
function is an 8th-order Chebyshev type-I lowpass filter with the cutoff 
frequency of 0.87/D. Using additional optional arguments, the filter order 
can be changed or an FIR filter of specified order and cutoff frequency 
can be used. 
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IX (a)| IV (a)| 
VAN Oy fh. Oy 
-r 0 m 

H (ax) 

Z 0 


ZO Zz 
D D 


IY (ay) 


FIGURE 9.7 Spectra of signals in the decimation of x(n) by a factor D 


Le pe 
D D 


EXAMPLE 9.2 Let x(n) = cos(0.1257n). Generate a large number of samples of x(n) and 
decimate them using D = 2, 4, and 8 to show the results of decimation. 


Solution We will plot the middle segments of the signals to avoid end-effects due to 
the default lowpass filter in the decimate function. The following MATLAB 
script shows details of these operations, and Figure 9.7 shows the plots of the 
sequences. 


n = 0:2048; ki = 256; k2 = k1+32; m = 0: (k2-k1); 
Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’,’inches’,’paperposition’,[0,0,6,4]); 


% (a) Original signal 

x = cos(0.125*pi*n); subplot(2,2,1); 

Ha = stem(m,x(mtki+1), Rey *filled’); axis([-1,33,-1.1,1.1]); 
set (Ha, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Original Sequence x(n)’,’fontsize’ ,TF) ; 
set(gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 


% (b) Decimation by D = 2 

D = 2; y = decimate(x,D); subplot(2,2,2); 

Hb = stem(m,y(mt+k1/D+1),’c’,’ filled’); axis([-1,33,-1.1,1.1]); 
set (Hb, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Decimated by D = 2’,’fontsize’ , TF); 
set(gca,’xtick’,[0,16,32]); set(gca, ’’ytick’,[-1,0,1]); 
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% (c) Decimation by D = 4 

D = 4; y = decimate(x,D); subplot(2,2,3); 

Hc = stem(m,y(mtk1/D+1),’r’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hc, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Decimated by D = 4’,’fontsize’ , TF); 
set(gca,’xtick’,[0,16,32]); set(gca, ’ytick’,[-1,0,1]); 
xlabel(’n’); 


% (d) Decimation by D = 8 

D = 8; y = decimate(x,D); subplot(2,2,4); 

Hd = stem(m,y(mtk1/D+1),’m’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hd, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Decimated by D = 8’,’fontsize’ , TF); 
set(gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 
xlabel(’n’); 


From Figure 9.8, we observe that the decimated sequences for D = 2 and 
D = 4 are correct and represent the original sinusoidal sequence x(n) at lower 
sampling rates. However, the sequence for D = 8 is almost zero because the 


Original Sequence x(n) Decimated by D = 2 


Amplitude 
Amplitude 


0 16 32 
Decimated by D = 4 Decimated by D = 8 
1 
® oO 
ne] me) 
zZ Z 
Z a a a a a a a a Z 0 
E E€ 
< < 
-1 
0 16 32 
n n 


FIGURE 9.8 Original and decimated signals in Example 9.2 
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lowpass filter has attenuated x(n) prior to downsampling. Recall that the cutoff 
frequency of the lowpass filter is set to 0.8r/D = 0.1m which eliminates x(n). 
If we had used the downsampling operation on x(n) instead of decimation, the 
resulting sequence would be y(m) = 1, which is an aliased signal. Thus, the 
lowpass filtering is necessary. 


9.3 INTERPOLATION BY A FACTOR I 
ee 


An increase in the sampling rate by an integer factor of J—i.e., Fy = 
IF,,—can be accomplished by interpolating J — 1 new samples between 
successive values of the signal. The interpolation process can be accom- 
plished in a variety of ways. We shall describe a process that preserves 
the spectral shape of the signal sequence x(n). This process can be ac- 
complished in two steps. The first step creates an intermediate signal at 
the high rate F, by interlacing zeros in between nonzero samples in an 
operation called upsampling. In the second step, the intermediate signal 
is filtered to “fill in” zero-interlaced samples to create the interpolated 
high-rate signal. As before, we will first study the time- and frequency- 
domain characteristics of the upsampled signal and then introduce the 
interpolation system. 


9.3.1 THE UPSAMPLER 

Let v(m) denote the intermediate sequence with a rate Fy = IF,, which 
is obtained from x(n) by adding I — 1 zeros between successive values of 
x(n). Thus, 


dee a(m/I), m=0,4+1,+21,... (0.28) 


0, otherwise 


and its sampling rate is identical to the rate of v(m). The block diagram 
of the upsampler is shown in Figure 9.9. Again, any system containing 
the upsampler is a time-varying system (Problem P9.1). 


a on 
Rate F, Rate IF, =F, 


FIGURE 9.9 An upsampling element 


EXAMPLE 9.3 Let J = 2 and a(n) = {1,2,3,4}. Verify that the upsampler is time varying. 
T 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Interpolation by a Factor [ 487 


Solution The upsampled signal is v(m) = {1,0,2,0,3,0,4,0}. If we now delay x(n) by 


; 
one sample, we get z(n—1) = {0, 1, 2,3, 4}. The corresponding upsampled signal 
T 


is vi(m) = {0,0, 1,0, 2,0, 3,0,4,0} = v(m — 2) and not v(m — 1). 
T 


MATLAB Implementation MATLAB provides the function [v] = 
upsample(x,I) that upsamples input array x into output v by insert- 
ing (I-1) zeros between input samples. An optional third parameter, 
“phase,” specifies the sample offset, which must be an integer between 
O and (1-1). For example, 


>> x = [1,2,3,4]; v = upsample(x,3) 


Gs 
il 0 0 2 0 0 3 (0) (0) 4 0 0 
upsamples by a factor of 2 starting with the first sample. However, 
>> v = upsample(x,3,1) 
y= 
1 0 0 2 0 0 3 0 0 4 0 
>> v = upsample(x,3,2) 
w= 
0 0 1 0 0 2 0 0 3 0 0 4 


produces two different signals by upsampling, starting with the second 
and the third sample (i.e., offset by 1), respectively. Note that the lengths 
of the upsampled signals are J times the length of the original signal. 


The frequency-domain representation of the upsampled signal 
y(m) The sequence v(m) has a z-transform 


Vige aca = X v(m™ = Xe") (9.27) 


m=— oo m=— oo 


The corresponding spectrum of v(m) is obtained by evaluating (9.27) on 
the unit circle. Thus 

V (wy) = X (wI) (9.28) 
where wy denotes the frequency variable relative to the new sampling rate 
Fy (ie., wy = 2nF/F,). Now the relationship between sampling rates 
is Fy = IFz, and hence the frequency variables wy and wy are related 
according to the formula 


ba (9.29) 
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IX(@)| IV (@)| 


=m 0 m _3n 2m ZO Z 2m 3z 
ali. T l l 
FIGURE 9.10 Spectra of x(n) and v(m) where V (wy) = X (wI) 


The spectra X (wg) and V (wy) are illustrated in Figure 9.10. We observe 
that the sampling rate increase, obtained by the addition of I — 1 zero 
samples between successive values of x(n), results in a signal whose spec- 
trum V (wy) is an I-fold periodic repetition of the input signal spectrum 
X (wz). 


9.3.2 THE IDEAL INTERPOLATOR 

Since only the frequency components of x(n) in the range 0 < wy < 
m/I are unique, the images of X(w) above wy = 7/I should be rejected 
by passing the sequence v(m) through a lowpass filter with a frequency 
response Hj(w,) that ideally has the characteristic 


0, otherwise 


Hy(wy) = (9.30) 


where ČC is a scale factor required to properly normalize the output 
sequence y(m). Consequently, the output spectrum is 


¥(w,) = CX (wy), 0 < |wy| < a/I (9.31) 


0, otherwise 


The scale factor C is selected so that the output y(m) = x(m/I) for 


m = 0,+/,+2I,.... For mathematical convenience, we select the point 
m = 0. Thus, 
1 T C n/I 
O= z | Yda = 5 / _, Xen iday (932) 


Since wy = w,/I, (9.32) can be expressed as 


tO FF 


C 
oly X (wa)dws = +2(0) (9.33) 


y(0) 


therefore, C = I is the desired normalization factor. 
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i Ideal Interpolator 
v(m) 
x(n) — DER- —— ym) 


FIGURE 9.11 Ideal interpolation by a factor I 


Finally, we indicate that the output sequence y(m) can be expressed 
as a convolution of the sequence v(n) with the unit sample response h(n) 
of the lowpass filter. Thus 


y(m) = X. h(m—k)v(k) (9.34) 


k=—0o 


Since v(k) = 0 except at multiples of I, where v(kI) = x(k), (9.34) 
becomes 


y(m) = X` h(m-—kI)2(k) (9.35) 


k=- 


The ideal interpolator is shown in Figure 9.11. 


MATLAB Implementation MATLAB provides the function [y,h] = 
interp(x,I) that resamples the signal in array x at I times the original 
sampling rate. The resulting resampled array y is I times longer—i.e., 
length(y) = I*length(x). The ideal lowpass filter given in (9.30) is 
approximated by a symmetric filter impulse response, h, which is designed 
internally. It allows the original samples to pass through unchanged and 
interpolates between so that the mean square error between them and 
their ideal values is minimized. The third optional parameter L specifies 
the length of the symmetric filter as 2*L*I+1, and the fourth optional 
parameter cutoff specifies the cutoff frequency of the input signal in 7 
units. The default values are L = 5 and cutoff = 0.5. Thus, if I = 2, 
then the length of the symmetric filter is 21 for the default L = 5. 


EXAMPLE 9.4 Let x(n) = cos(mn). Generate samples of x(n) and interpolate them using J = 2, 
4, and 8 to show the results of interpolation. 


Solution We will plot the middle segments of the signals to avoid end-effects due to 
the default lowpass filter in the interp function. The following MATLAB 
script shows details of these operations, and Figure 9.12 shows the plots of the 
sequences. 
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FIGURE 9.12 Original and interpolated signals in Example 9.4 


n = 0:256; ki = 64; k2 = k1+32; m = 0: (k2-k1); 
figure(’units’,’inches’,’position’,[1,1,6,4],... 
?paperunits’,’inches’, ’paperposition’,[0,0,6,4]); 


T 

Fh 

fare 
Ul 


% (a) Original signal 

x = cos(pitn); subplot(2,2,1); 

Ha = stem(m,x(mtki+1),’g’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Ha, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Original Sequence x(n)’, ’fontsize’ ,TF) ; 
set(gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 


% (b) Interpolation by I = 2 

I = 2; y = interp(x,I); subplot(2,2,2); 

Hb = stem(m,y(m+tk1*I+1),’c’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hb, ’markersize’,2); ylabel(’ Amplitude’) ; 
title(’Interpolated by I = 2’,’fontsize’ , TF); 

set (gca,’xtick’,[0,16,32]); set(gca,’’ytick’,[-1,0,1]); 
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% (c) Interpolation by I = 4 

I = 4; y = interp(x,I); subplot(2,2,3); 

Hc = stem(m,y(mt+k1*I+1),’r’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hc, ’markersize’,2); ylabel(’ Amplitude’) ; 
title(’Interpolated by I = 4’,’fontsize’ , TF); 

set (gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 
xlabel(’n’); 


% (d) Interpolation by I = 8 

I = 8; y = interp(x,I); subplot(2,2,4); 

Hd = stem(m,y(mt+k1*I+1),’m’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hd, ’markersize’,2); ylabel(’ Amplitude’) ; 
title(’Interpolated by I = 8’,’fontsize’ , TF); 

set (gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 
xlabel(’n’); 


From Figure 9.11, we observe that the interpolated sequences for all three values 
of I are appropriate and represent the original sinusoidal signal x(n) at higher 
sampling rates. In the case of I = 8, the resulting sequence does not appear to 
be perfectly sinusoidal in shape. This may be due the fact the lowpass filter is 
not close to an ideal filter. 


EXAMPLE 9.5 Examine the frequency response of the lowpass filter used in the interpolation 
of the signal in Example 10.4. 


Solution The second optional argument in the interp function provides the impulse 
response from which we can compute the frequency response, as shown in the 
following MATLAB script. 


n = 0:256; x = cos(pitn); w = [0:100]*pi/100; 
Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’ ,’ inches’ ,’paperposition’,[0,0,6,4]); 


% (a) Interpolation by I = 2, L = 5; 

I = 2; [y,h] = interp(x,I); H = freqz(h,1,w); H = abs(H); 

subplot(2,2,1); plot(w/pi,H,’g’); axis([0,1,0,1+0.1]); ylabel(’Magnitude’) ; 
title(’I = 2, L = 5’,’fontsize’ ,TF); 

set (gca,’xtick’,[0,0.5,1]); set(gca, ’ytick’,[0:1:1]); 


% (b) Interpolation by I = 4, L = 5; 

I = 4; [y,h] = interp(x,I); H = freqz(h,1,w); H = abs(H); 

subplot(2,2,2); plot(w/pi,H,’g’); axis([0,1,0,1+0.2]); ylabel(’Magnitude’) ; 
title(’I = 4, L = 5’,’fontsize’ ,TF); 

set(gca,’xtick’,[0,0.25,1]); set(gca,’ytick’,[0:1:I]); 
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FIGURE 9.13 Filter frequency responses in Example 9.5 


% (c) Interpolation by I = 8, L = 5; 

I = 8; [y,h] = interp(x,I); H = freqz(h,1,w); H = abs(H); 

subplot (2,2,3); plot(w/pi,H,’g’); axis([0,1,0,I+0.4]); ylabel(’Magnitude’) ; 
title(’?I = 8, L = 5’,’fontsize’,TF); xlabel(’\omega/\pi’ ,’fontsize’,10) 

set (gca,’xtick’,[0,0.125,1]); set(gca, ’ytick’,[0:2:1]); 


% (d) Interpolation by I = 8, L = 10; 

I = 8; [y,h] = interp(x,1,10); H = freqz(h,1,w); H = abs(H); 

subplot(2,2,4); plot(w/pi,H,’g’); axis([0,1,0,1+0.4]); ylabel(’Magnitude’) ; 
title(’I = 8, L = 10’,’fontsize’,TF); xlabel(’\omega/\pi’, ’fontsize’ ,10) 
set(gca,’xtick’,[0,0.125,1]); set(gca, ’ytick’,[0:2:1]); 


The frequency response plots are shown in Figure 9.13. The first three plots 
are for L = 5 and, as expected, the filters are all lowpass with passband edges 
approximately around z/J frequencies and the gain of J. Also note that the 
filters do not have sharp transitions and thus are not good approximations to 
the ideal filter. The last plot shows the response for L = 10, which indicates 
a more sharp transition, which is to be expected. Any value beyond L = 10 
results in an unstable filter design and hence should be avoided. 
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9.4 SAMPLING RATE CONVERSION BY A RATIONAL FACTOR I/D 
—— gp 


Having discussed the special cases of decimation (downsampling by a fac- 
tor D) and interpolation (upsampling by a factor I), we now consider 
the general case of sampling rate conversion by a rational factor I/D. 
Basically, we can achieve this sampling rate conversion by first perform- 
ing interpolation by the factor J and then decimating the output of the 
interpolator by the factor D. In other words, a sampling rate conversion 
by the rational factor I/D is accomplished by cascading an interpolator 
with a decimator, as illustrated in Figure 9.14. 

We emphasize that the importance of performing the interpolation 
first and the decimation second is to preserve the desired spectral charac- 
teristics of x(n). Furthermore, with the cascade configuration illustrated 
in Figure 9.14, the two filters with impulse response {hy(k)} and {ha(k)} 
are operated at the same rate, namely IF, and hence can be combined 
into a single lowpass filter with impulse response h(k), as illustrated in 
Figure 9.15. The frequency response H(w,) of the combined filter must 
incorporate the filtering operations for both interpolation and decimation, 
and hence it should ideally possess the frequency-response characteristic 
Hw) = I,0< |e < min(/D, 7/1) (0.36) 

0, otherwise 


where wy = 27 F/F, = 2r F/I Fy = wz/1. 


Explanation of (9.36) Note that V(w,) and hence W(w,) in 
Figure 9.15 are periodic with period 27/I. Thus, if 


e D< I, then filter H(w,) allows a full period through and there is no 
net lowpass filtering. 

e D> TI, then filter must first truncate the fundamental period of W (wy) 
to avoid aliasing error in the (D|1) decimation stage to follow. 


Putting these two observations together, we can state that when 
D/I < 1, we have net interpolation and no smoothing is required by 


| vk) PIDEAL] ' | [IDEAL Jwik) | 

x(n) —> 11 LPF o LPF ip H ym) 
! hy(k) RD hg(k) 
IF; MI! IF, i tear, 


FIGURE 9.14 Cascade of interpolator and decimator for sampling rate conver- 
sion by a factor I/D 
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FIGURE 9.15 Method for sampling rate conversion by a factor I/D 


H(wy) other than to extract the fundamental period of W(w,). In this 
respect, H(w,) acts as a lowpass filter as in the ideal interpolator. On 
the other hand, if D/I > 1, then we have net decimation. Hence it is 
necessary to first truncate even the fundamental period of W(w,) to get 
the frequency band down to [—17/D,2/D] and to avoid aliasing in the 
decimation that follows. In this respect, H(w,) acts as a smoothing filter 
in the ideal decimator. When D or I is equal to 1, the general deci- 
mator/interpolator in Figure 9.15 along with (9.36) reduces to the ideal 
interpolator or decimator as special case, respectively. 
In the time domain, the output of the upsampler is the sequence 


=| 50 k=0,+1,421,... 


(9.37) 


0, otherwise 


and the output of the linear time-invariant filter is 


w(k)= So h(k- OwA) = So hlk- trael) (9.38) 


l=- l=- 


Finally, the output of the sampling rate converter is the sequence {y(m)}, 
which is obtained by downsampling the sequence {w(k)} by a factor of 
D. Thus 


y(m)=w(mD)= X` h(mD — 4)x(8) (9.39) 
l=- 


It is illuminating to express (9.39) in a different form by making a 
change in variable. Let 
D 
= Ka -n (9.40) 


where the notation|r| denotes the largest integer contained in r. With 
this change in variable, (9.39) becomes 


es a(m—|"2] r402)2([M2|—2) ay 


n=— Co 


We note that 


Pi | I = (mD) modulo I = ((mD)); 
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FIGURE 9.16 Examples of signals x(n), v(k), w(k), and y(m) in the sampling 


rate converter of Figure 9.15 for I = 3 and D = 2 


Consequently, (9.41) can be expressed as 


sS har + (D)e (|Z| -n) 04 


n=—Co 


These operations are shown in Figure 9.16 for J = 3 and D = 2. 

It is apparent from (9.41) and Figure 9.16 that the output y(m) is 
obtained by passing the input sequence x(n) through a time-variant filter 
with impulse response 


g(n,m) = h[nI+((mD))7] -wo<mn<o (9.43) 
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where h(k) is the impulse response of the time-invariant lowpass filter 
operating at the sampling rate IF. We further observe that for any 
integer k, 


g(n,m + kI) = h[nl + ((mD+kDI))7] = h[nI + ((mD))z] 
= g(n,m) (9.44) 


Hence g(n, m) is periodic in the variable m with period 7. 

Regarding the computational complexity of the lowpass filter in the 
general resampler, we note that it has a nonzero input only every J sam- 
ples and the output is required only every D samples. If we use an FIR im- 
plementation for this lowpass filter, we need only compute its output one 
out of every D samples. However, if we instead use IIR implementation, 
we would generally have to compute intermediate outputs also because 
of the recursive nature of the filter. However, both types of filter benefit 
from the computational savings due to their sparse input. 


The frequency-domain representation of the resampled signal 

y(m) The frequency-domain relationships can be obtained by combin- 

ing the results of the interpolation and decimation process. Thus, the 

spectrum at the output of the linear filter with impulse response h(k) is 
V(wy) = H(wy)X (wT) 

7 IX (w,I), 0 < |wy| < min(x/D, 2/1) 


‘ (9.45) 
0, otherwise 


The spectrum of the output sequence y(m), obtained by decimating the 
sequence u(n) by a factor of D, is 


D-1 


Vig 4 2 v (=) (9.46) 


where wy = Dwy. Since the linear filter prevents aliasing as implied by 
(9.45), the spectrum of the output sequence given by (9.46) reduces to 


I 
p* (=) , 0 < |wy| < min (x, z2) 
Y (wy) = 


0, otherwise 


(9.47) 


MATLAB Implementation MATLAB provides the function [y,h] 
= resample(x,I,D) that resamples the signal in array x at I/D times 
the original sampling rate. The resulting resampled array y is I/D times 
longer (or the ceiling of it if the ratio is not an integer)—i.e., length(y) = 
ceil (I/D) *length(x). The function approximates the anti-aliasing (low- 
pass) filter given in (9.36) by an FIR filter, h, designed (internally) using 
the Kaiser window. It also compensates for the filter’s delay. 
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The length of the FIR filter h that resample uses is proportional to 
the fourth (optional) parameter L that has the default value of 10. For 
L = 0, resample performs a nearest-neighbor interpolation. The fifth op- 
tional parameter beta (default value 5) can be used to specify the Kaiser 
window stopband attenuation parameter 3. The filter characteristics can 
be studied using the impulse response h. 


EXAMPLE 9.6 Consider the sequence x(n) = cos(0.1257n) discussed in Example 9.2. Change 
its sampling rate by 3/2, 3/4, and 5/8. 


Solution The following MATLAB script shows the details. 


n = 0:2048; k1 = 256; k2 = ki+32; m = 0: (k2-k1); 
Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’,’inches’, ’paperposition’,[0,0,6,4]); 


% (a) Original signal 

x = cos(0.125*pi*n); subplot(2,2,1); 

Ha = stem(m,x(mtki+1),’g’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Ha, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Original Sequence x(n)’,’fontsize’ ,TF) ; 

set (gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 


% (b) Sample rate Conversion by 3/2: I= 3, D = 2 

I = 3; D = 2; y = resample(x,I,D); subplot(2,2,2); 

Hb = stem(m,y(m+k1*I/D+1),’c’,’ filled’); axis([-1,33,-1.1,1.1]); 
set (Hb, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Sample Rate I/D: I = 3, D = 2’,’fontsize’ ,TF); 
set(gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 


% (c) Sample rate Conversion by 3/4: I= 3, D = 4 

I = 3; D = 4; y = resample(x,1I,D); subplot(2,2,3); 

Hc = stem(m,y(m+k1*I/D+1),’r’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hc, ’’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Sample Rate I/D: I = 3, D = 4’,’fontsize’ ,TF); 
set(gca,’?xtick’,[0,16,32]); set(gca, ’ytick’,[-1,0,1]); 
xlabel(’n’, ’fontsize’ ,LF); 


% (d) Sample rate Conversion by 5/8: I= 5, D = 8 

I = 5; D = 8; y = resample(x,I,D); subplot(2,2,4); 

Hd = stem(m,y(m+k1*I/D+1),’m’,’filled’); axis([-1,33,-1.1,1.1]); 
set (Hd, ’markersize’,2); ylabel(’ Amplitude’) ; 

title(’Sample Rate I/D: I = 5, D = 8’,’fontsize’ ,TF); 

set (gca,’xtick’,[0,16,32]); set(gca,’ytick’,[-1,0,1]); 
xlabel(’n’, ’fontsize’ ,LF); 


The resulting plots are shown in Figure 9.17. The original x(n) signal has 16 
samples in one period of the cosine waveform. Since the first sampling rate 
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FIGURE 9.17 Original and resampled signals in Example 9.6 


conversion by 3/2 is greater than one, the overall effect is to interpolate x(n). 
The resulting signal has 16 x 3/2 = 24 samples in one period. The other two 
sampling rate conversion factors are less than one; thus, overall effect is to 
decimate x(n). The resulting signals have 16 x 3/4 = 12 and 16 x 5/8 = 10 
samples per period, respectively. 


9.5 FIR FILTER DESIGNS FOR SAMPLING RATE CONVERSION 
ee 


In practical implementation of sampling rate converters we must replace 
the ideal lowpass filters of equations (9.20), (9.30), and (9.36) by a prac- 
tical finite-order filter. The lowpass filter can be designed to have linear 
phase, a specified passband ripple, and stopband attenuation. Any of the 
standard, well-known FIR filter design techniques (e.g., window method, 
frequency sampling method) can be used to carry out this design. We 
consider linear-phase FIR filters for this purpose because of their ease 
of design and because they fit very nicely into a decimator stage where 
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FIGURE 9.18 An FIR integer interpolator 


only one of D outputs is required [see the discussion following (9.44) on 
page 496]. We will first discuss integer interpolators, followed by integer 
decimators and then the rational resamplers. The main emphasis will be 
on the specifications of these FIR lowpass filters, since the design problem 
has already been considered in Chapter 7. 


9.5.1 FIR INTEGER INTERPOLATION 

Replacing the ideal filter of the system given on page 489 with an FIR 
filter, we obtain the system shown in Figure 9.18. The relevant equation 
that relates the Fourier transforms V(w) and X(w) is (9.28), repeated 
here for convenience. 


V(w) = X(wl) (9.48) 


Considering the frequency compression by J and the required amplitude 
scale factor of I, the ideal lowpass filter was determined in (9.30) and 
(9.33) to be 


Hey Oo ae (9.49) 


0, otherwise. 


MATLAB Implementation To design a linear-phase FIR filter for 
use in interpolation (and as we shall see later for decimation) operation, 
MATLAB provides the function h = intfilt(1I,L,alpha). When used 
on a sequence interspersed with I-1 consecutive zeros between every I 
samples, the function performs ideal bandlimited interpolation using the 
nearest 2*L nonzero samples. It assumes that the bandwidth of the signal 
x(n) is alpha times 7 radians/sample—i.e., alpha=1 means the full signal 
bandwidth. The length of the filter impulse response array h is 2*I*L-1. 
The designed filter is identical to that used by the interp function. There- 
fore, the parameter L should be chosen carefully to avoid numerical insta- 
bility. It should be a smaller value for higher I value but no more than ten. 


EXAMPLE 9.7 Design a linear-phase FIR interpolation filter to interpolate a signal by a factor 
of 4, using the bandlimited method. 
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Solution We will explore the intfilt function for the design using L = 5 and study the 
effect of alpha on the filter design. The following MATLAB script provides the 
detail. 

I=4; L=5; 


Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’,’inches’,’paperposition’,[0,0,6,4]); 


% (a) Full signal bandwidth: alpha = 1 

alpha = 1; h = intfilt(1,L,alpha); 

[Hr,w,a,L] = Hr_Type1(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min) ; 
H = abs(freqz(h,1,w)); Hdb = 20*1og10(H/max(H)); min_attn = Hdb(w_min) ; 
subplot(2,2,1); plot(ww/pi,Hr,’g’,’linewidth’,1.0); axis([0,1,-1,5]); 
set(gca,’xtick’,[0,1/1,1],’ytick’,[0,I]); grid; ylabel(’ Amplitude’) ; 
title(’ Amplitude Response: alpha = 1’,’fontsize’ ,TF) 


subplot (2,2,3); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-50,10]); 
set(gca,’xtick’,[0,1/I,1],’ytick’,[-50,round(min_attn) ,0]); grid 
ylabel(’Decibels’); xlabel(’\omega/\pi’, ’fontsize’,10); 

title(’Log-mag Response: alpha = 1’,’fontsize’ ,TF) 


% (b) Partial signal bandwidth: alpha = 0.75 

alpha = 0.75; h = intfilt(I,L,alpha) ; 

[Hr,w,a,L] = Hr_Typei(h); Hr_min = max(Hr(end/2:end)); w_min = find(Hr == Hr_min); 
H = abs(freqz(h,1,w)); Hdb = 20*log10(H/max(H)); min_attn = Hdb(w_min) ; 
subplot(2,2,2); plot(ww/pi,Hr,’g’,’linewidth’,1.0); axis([0,1,-1,5]); 
set(gca,’xtick’,[0,1/1,1],’ytick’,[0,1]); grid; ylabel(’ Amplitude’) ; 
title(’Amplitude Response: alpha = 0.75’,’fontsize’ ,TF) 


subplot (2,2,4); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-50,10]); 
set(gca,’xtick’,[0,1/I,1],’ytick’, [-50,round(min_attn) ,0]); grid 
ylabel(’Decibels’); xlabel(’\omega/\pi’, ’fontsize’,10); 

title(’Log-mag Response: alpha = 0.75’,’fontsize’ , TF) 


The plots are shown in Figure 9.19. For the full bandwidth case of alpha = 1, 
the filter has more ripple in both the passband and the stopband with the 
minimum stopband attenuation of 22 DB. This is because the filter transition 
band is very narrow. For alpha = 0.75, the filter specifications are more lenient, 
and hence its response is well behaved with minimum stopband attenuation of 
40 DB. Note that we do not have complete control over other design parameters. 
These issues are discussed in more detail further along in this section. 


In the following example, we design a linear-phase equiripple FIR 
interpolation filter using the Parks-McClellen algorithm. 


EXAMPLE 9.8 Design an interpolator that increases the input sampling rate by a factor of 
I = 5. Use the firpm algorithm to determine the coefficients of the FIR filter 
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FIGURE 9.19 FIR interpolation filter design plots for I = 4 and L = 5 
that has 0.1 dB ripple in the passband and is down by at least 30 dB in the 
stopband. Choose reasonable values for band-edge frequencies. 
Solution The passband cutoff frequency should be wp = 1/I = 0.27. To get a reasonable 


value for the filter length we choose the transition width of 0.127, which gives 
stopband cutoff frequency of ws = 0.327. Note that the nominal gain of the 
filter in the passband should be equal to J = 5, which means that the ripple 
values computed using the decibel values are scaled by 5. A filter of length 
M = 31 achieves the design specifications given above. The details are given in 
the following MATLAB script. 


I = 5; Rp = 0.1; As = 30; wp = pi/I; ws = wptpix0.12; 

[deltal,delta2] = db2delta(Rp,As); weights = [delta2/delta1,1]; 

F = [0,wp,ws,pi]/pi; A = [1,1,0,0]; 

h = firpm(30,F,A,weights); n = [0:length(h)-1]; 

[Hr,w,a,L] = Hr_Type1(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min) ; 
H = abs(freqz(h,1,w)); Hdb = 20*1og10(H/max(H)); min_attn = Hdb(w_min) ; 
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Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 

>paperunits’,’inches’ ,’paperposition’,[0,0,6,4]); 
subplot(2,2,1); Hs1 = stem(n,h,’filled’); set(Hs1,’markersize’ ,2); 
axis([-1,length(n) ,-0.5,1.5]); ylabel(’Amplitude’); xlabel(’n’,’vertical’,’bottom’) ; 
Title(’Impulse Response’, ’fontsize’ ,TF) ; 
subplot (2,2,3); plot(ww/pi,Hr,’m’,’linewidth’,1.0); axis([0,1,-1,6]); 
set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[0,1]); grid; ylabel(’ Amplitude’) ; 
title(’ Amplitude Response’ ,’fontsize’,TF); xlabel(’Frequency in \pi units’); 


subplot(2,2,2); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-50,10]); 
set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-50,round(min_attn) ,0]); grid 
ylabel(’Decibels’) ; 

title(’Log-magnitude Response’, ’fontsize’ ,TF) ; 


subplot (2,2,4); 

lw = length(w)-1; PB = [0:floor(wp/pi*lw)]; HrPB = Hr(PB+1)-I; 
SB = [ceil(ws/pi*lw):lw]; HrSB = Hr(SB+1); 

[AX,H1,H2] = plotyy(PB/1w,HrPB,SB/1w,HrSB) ; 


deltai = round(delta1i*1I*100)/100; delta2 = round(delta2*I*100)/100; 

set (AX(1),’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-delta1,0,deltai],’Ycolor’,’g’); 
set (AX(2),’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-delta2,0,delta2],’Ycolor’,’r’); 
set(H1,’color’,’g’,’linewidth’,1); set(H2,’color’,’r’,’linewidth’ ,1); 
title(’Scaled Ripples’, ’fontsize’,TF); xlabel(’Frequency in \pi units’); 


The responses of the designed FIR filter are given in Figure 9.20. Even 
though this filter passes the original signal, it is possible that some of the neigh- 
boring spectral energy may also leak through if the signal is of full bandwidth 
of m radians. Hence we need better design specifications, which are discussed 
further along in this section. 


MATLAB Implementation To use the FIR filter for interpolation 
purposes (such as the one designed in Example 9.8), MATLAB has pro- 
vided a general function, upfirdn, that can be used for interpolation 
and decimation as well as for resampling purposes. Unlike other functions 
discussed in this chapter, upfirdn incorporates the user-defined FIR fil- 
ter (which need not be linear phase) in the operation. When invoked as 
y = upfirdn(x,h,I), the function upsamples the input data in the array 
x by a factor of the integer I and then filters the upsampled signal data 
with the impulse response sequence given in the array h to produce the 
output array y, thus implementing the system in Figure 9.18. 


EXAMPLE 9.9 Let x(n) = cos(0.57n). Increase the input sampling rate by a factor of I = 5, 
using the filter designed in Example 9.8. 
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FIGURE 9.20 Responses of the FIR interpolation filter in Example 9.8 
Solution The steps are given in the following MATLAB script. 


% Given Parameters: 

I = 5; Rp = 0.1; As = 30; wp = pi/I; ws = 0.32*pi; 
[deltal,delta2] = db2delta(Rp,As); weights = [delta2/deltai,1]; 
n = [0:50]; x = cos(0.5*pi*n) ; 

ni = n(1:17); x1 = x(17:33); % for plotting purposes 


% Input signal 

Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’,’inches’,’paperposition’,[0,0,6,4]); 

subplot(2,2,1); Hs1 = stem(n1,x1,’filled’); set(Hs1,’markersize’ ,2,’color’,’g’); 

set (gca,’xtick’,[0:4:16],’ytick’,[-1,0,1]); 

axis([-1,17,-1.2,1.2]); ylabel(’ Amplitude’); xlabel(’n’,’vertical’,’middle’) ; 

Title(’ Input Signal x(m)’,’fontsize’ ,TF) ; 


% Interpolation with Filter Design: Length M = 31 

M = 31; F = [0,wp,ws,pil]/pi; A = [1,1,0,0]; 

h = firpm(M-1,F,A,weights); y = upfirdn(x,h,I); 

delay = (M-1)/2; % Delay imparted by the filter 

m = delay+1:1:50*I+delay+1; y = y(m); m = 1:81; y = y(81:161); % for plotting 
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FIGURE 9.21 Signal plots in Example 9.9 


subplot(2,2,2); Hs2 = stem(m,y,’filled’); set(Hs2,’markersize’ ,2,’color’,’m’); 
axis([-5,85,-1.2,1.2]); set (gca, *xtick’ ,[0:4:16]*I, ?ytick’, [-1,0,1]); 
title(’Output y(n): Filter length=31’,’fontsize’ ,TF) ; 
xlabel(’n’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


The signal stem plots are shown in Figure 9.21. The upper left-hand plot shows 
a segment of the input signal x(n), and the upper right-hand plot shows the 
interpolated signal y(n) using the filter of length 31. The plot is corrected for 
filter delay and the effect of its transient response. It is somewhat surprising that 
the interpolated signal is not what it should be. The signal peak is more than 
one, and the shape is distorted. A careful observation of the filter response plot 
in Figure 9.20 reveals that the broad transition width and a smaller attenuation 
has allowed some of the spectral energy to leak, creating a distortion. 

To investigate this further, we designed filters with larger orders of 51 and 
81, as detailed in the following MATLAB script. 


% Interpolation with Filter Design: Length M = 51 
M = 51; F = [0,wp,ws,pi]/pi; A = [I,1,0,0]; 
firpm(M-1,F,A,weights); y = upfirdn(x,h,I); 


= 
Il 
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delay = (M-1)/2; % Delay imparted by the filter 

m = delay+1:1:50*I+delay+1; y = y(m); m = 1:81; y = y(81:161); 

subplot (2,2,3); Hs3 = stem(m,y,’filled’); set(Hs3,’markersize’ ,2,’color’,’m’); 
axis([-5,85,-1.2,1.2]); set (gca,’xtick’,[0:4:16]*I,’ytick’,[-1,0,1]); 
title(’Output y(n): Filter length=51’,’fontsize’ , TF); 
xlabel(’n’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


% Interpolation with Filter Design: Length M = 81 

M = 81; F = [0,wp,ws,pil]/pi; A = [I,1,0,0]; 

h = firpm(M-1,F,A,weights); y = upfirdn(x,h,I); 

delay = (M-1)/2; % Delay imparted by the filter 

m = delay+1:1:50*I+delay+1; y = y(m); m = 1:81; y = y(81:161); 

subplot (2,2,4); Hs3 = stem(m,y,’filled’); set(Hs3,’markersize’ ,2,’color’,’m’); 
axis([-5,85,-1.2,1.2]); set(gca,’xtick’,[0:4:16]*I,’ytick’,[-1,0,1]); 
title(’Output y(n): Filter length=81’ ,’fontsize’ , TF); 
xlabel(’n’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


The resulting signals are also shown in lower plots in Figure 9.21. Clearly, for 
large orders, the filter has better lowpass characteristics. The signal peak value 
approaches 1, and its shape approaches the cosine waveform. Thus, a good filter 
design is critical even in a simple signal case. 


9.5.2 DESIGN SPECIFICATIONS 

When we replace Hy(w) by a finite-order FIR filter H(w), we must allow 
for a transition band; thus, the filter cannot have a passband edge up to 
m/I. Towards this, we define 


© Wz pas the highest frequency of the signal x(n) that we want to preserve 
e ws as the full signal bandwidth of x(n),—i.e., there is no energy in 
x(n) above the frequency wgs. 


Thus, we have 0 < wrp < Wrs < T. Note that the parameters wg,p 
and wgs, as defined are signal parameters, not filter parameters; they are 
shown in Figure 9.22a. The filter parameters will be defined based on w, 5 
and wgr,s- 

From equation (9.48), these signal parameter frequencies for v(m) 
become wz,p/I and wz,;/I, respectively, because the frequency scale is 
compressed by the factor J. This is shown in Figure 9.22b. A linear-phase 
FIR filter can now be designed to pass frequencies up to wy p/I and to 
suppress frequencies starting at (27 — wz s)/I. Let 


_ [(Wrp 7 27 — Wy, 
i ( 7 ) and ws = (== ) (9.50) 
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FIGURE 9.22 Frequency parameters: (a) signal, (b) filter 


be the passband and stopband edge frequencies, respectively, of the low- 
pass linear-phase FIR filter given by 
H(w) = H, (w) (9.51) 


where H,(w) is the real-valued amplitude response and (w) is the un- 
wrapped phase response. Then we have the following filter design specifi- 


cations: 
1 
pie) < 146; for |w| € [0, wp] 
(9.52) 
1 
pin) < +6) for |w| € [ws, 7] 


where wp and ws are as given in (9.50) and 6, and 69 are the passband 
and stopband ripple parameters, respectively, of the lowpass FIR filter. 


Comment: Instead of beginning the stopband at a/I, we were able to 
shift it to (2r — ws) /I. If ws,s {K a, then this will be an important con- 
sideration to lower filter order. However, in the worst-case scenario of 
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Wg, s = T, the stopband will begin at +, which is the same as in the ideal 
lowpass filter of (9.49). Almost always wz. < m, and we can then choose 
Wz p as close to wz s as we want. However, this will reduce the size of the 
transition band, which means a higher filter order. 


EXAMPLE 9.10 Design a better FIR lowpass filter for sampling rate increase by a factor of I = 5 
for the signal in Example 9.9. 


Solution Since x(n) = cos(0.57n), the signal bandwidth and bandwidth to be preserved 
are the same—i.e., Wz,p = W2,s = 0.57. Thus, from (9.50), wp = 0.57/5 = 0.17 
and ws = (27 — 0.57)/5 = 0.37. We will design the filter for Rp = 0.01 and 
As = 50 dB. The resulting filter order is 32, which is 2 higher than the one in 
Example 9.9 but with much superior attenuation. The details are given below. 


% Given Parameters: 

n = [0:50]; wxp = 0.5*pi; x = cos(wxp*n) ; 

ni = n(1:9); x1 = x(9:17); % for plotting purposes 

I = 5; I = 5; Rp = 0.01; As = 50; wp = wxp/I; ws = (2*pi-wxp)/I; 
[delta1,delta2] = db2delta(Rp,As); weights = [delta2/delta1,1]; 
[N,Fo,Ao,weights] = firpmord([wp,ws]/pi, [1,0], [delta1,delta2] ,2);N = N+2; 


% Input signal 
Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 

>paperunits’,’inches’ ,’paperposition’,[0,0,6,4]); 
subplot(2,2,1); Hs1 = stem(n1,x1,’filled’); set(Hs1,’markersize’ ,2,’color’,’g’); 
set (gca,’xtick’,[0:4:16],’ytick’,[-1,0,1]); 
axis([-1,9,-1.2,1.2]); ylabel(’Amplitude’); xlabel(’n’,’vertical’,’middle’) ; 
Title(’ Input Signal x(n)’,’fontsize’ ,TF) ; 


% Interpolation with Filter Design: Length M = 31 

h = firpm(N,Fo,I*Ao,weights); y = upfirdn(x,h,I); 

delay = (N)/2; % Delay imparted by the filter 

m = delay+1:1:50*I+delay+1; y = y(m); m = 0:40; y = y(81:121); 

subplot(2,2,3); Hs2 = stem(m,y,’filled’); set(Hs2,’markersize’ ,2,’color’,’m’); 
axis([-5,45,-1.2,1.2]); set(gca,’xtick’,[0:4:16]*I,’ytick’,[-1,0,1]); 
title(’Output Signal y(n): I=5’,’fontsize’ ,TF) ; 
xlabel(’m’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


% Filter Design Plots 

[Hr,w,a,L] = Hr_Type1(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min) ; 

H = abs(freqz(h,1,w)); Hdb = 20*log10(H/max(H)); min_attn = Hdb(w_min) ; 
subplot(2,2,2); plot(ww/pi,Hr,’m’,’linewidth’,1.0); axis([0,1,-1,6]); 

set (gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[0,1]); grid; ylabel(’ Amplitude’) ; 
title(’ Amplitude Response’ ,’fontsize’ ,TF) ; 

xlabel(’Frequency in \pi units’, ’vertical’,’middle’); 

subplot(2,2,4); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-60,10]); 
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FIGURE 9.23 Signal plots and filter design plots in Example 9.10 


set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-60,round(min_attn) ,0]); grid 
ylabel(’Decibels’); xlabel(’Frequency in \pi units’,’vertical’,’middle’) ; 
title(’Log-magnitude Response’ ,’fontsize’ , TF) ; 


The signal stem plots and filter design plots are shown in Figure 9.23. The 
designed filter has a minimum stopband attenuation of 53 dB, and the resulting 
interpolation is accurate even with the filter order of 32. 


9.5.3 FIR INTEGER DECIMATION 

Consider the system in Figure 9.5 on page 481 in which the ideal lowpass 
filter is replaced by an FIR filter H(w), which then results in the system 
shown in Figure 9.24. The relationship between Y(w,) and X(w) is given 
by (9.24), which is repeated here for convenience 


D-1 
Y (wy) = : n(o- E) x (u N; w= (9.53) 
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FIGURE 9.24 An FIR integer decimator 


which is nothing but the aliased sum of the H(w)X(w). Thus, the condi- 
tion necessary to avoid aliasing is 
< |u| <n (9.54) 
Then, 
1 
Y (ay) pi w)H(w) (9.55) 


as in (9.25), where the ideal filtering was accomplished with Hp(w) as 
given in (9.20). 


EXAMPLE 9.11 Design a decimator that downsamples an input signal x(n) by a factor D = 2. 
Use the firpm algorithm to determine the coefficients of the FIR filter that has 
a 0.1 dB ripple in the passband and is down by at least 30 dB in the stopband. 
Choose reasonable values for band-edge frequencies. 


Solution The passband cutoff frequency should be wp = T/D = 0.57. To get a reasonable 
value for the filter length we choose the transition width of 0.17, which gives 
stopband a cutoff frequency of ws = 0.37. A filter of length M = 37 achieves the 
preceding design specifications. The details are given in the following MATLAB 
script. 


% Filter Design 

D = 2; Rp = 0.1; As = 30; wp = pi/D; ws = wp+0.1*pi; 

[deltai,delta2] = db2delta(Rp,As) ; 

(N,F,A,weights] = firpmord([wp,ws]/pi, [1,0], [delta1,delta2] ,2); 

h = firpm(N,F,A,weights); n = [0:length(h)-1]; 

[Hr,w,a,L] = Hr_Type1(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min) ; 
H = abs(freqz(h,1,w)); Hdb = 20*logi0(H/max(H)); min_attn = Hdb(w_min); 


Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 

>paperunits’,’inches’, ’paperposition’,[0,0,6,4]); 
subplot(2,2,1); Hs1 = stem(n,h,’filled’); set(Hs1,’markersize’ ,2); 
axis([-1,length(n) ,-0.15,0.6]); ylabel(’ Amplitude’, ’vertical’,’cap’); 
xlabel(’n’,’vertical’,’bottom’);set(gca, ’xtick’, [n(1) ,n(end)],’ytick’,[0,0.5]); 
Title(’Impulse Response’ ,’fontsize’,TF,’vertical’,’baseline’) ; 


subplot (2,2,3); plot(w/pi,Hr,’m’,’linewidth’,1.0); axis([0,1,-0.1,1.1]); 
set (gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[0,1]); grid; 
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ylabel(’ Amplitude’ ,’vertical’,’cap’); 
title(’ Amplitude Response’ ,’fontsize’,TF,’vertical’,’baseline’) ; 
xlabel(’Frequency in \pi units’,’vertical’,’middle’) ; 


subplot(2,2,2); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-50,10]); 
set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-50,round(min_attn) ,0]); grid 
ylabel(’Decibels’,’vertical’,’cap’); 

xlabel(’Frequency in \pi units’,’vertical’,’middle’) ; 
title(’Log-magnitude Response’, ’fontsize’,TF,’vertical’,’baseline’) ; 


subplot (2,2,4); 

lw = length(w)-1; PB = [0:floor(wp/pi*lw)]; HrPB = Hr(PB+1)-1; 

SB = [ceil(ws/pi*lw):lw]; HrSB = Hr(SB+1); 

[AX,H1,H2] = plotyy(PB/1w,HrPB,SB/1w,HrSB) ; 

deltai = round(delta1*1000)/1000; delta2 = round(delta2*100)/100; 

set (AX(1),’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-delta1,0,deltai],’Ycolor’,’g’); 
set (AX(2) ,’xtick’,[0,wp/pi,ws/pi,1],’ytick’ ,[-delta2,0,delta2],’Ycolor’,’r’); 
set(H1,’color’,’g’,’linewidth’,1); set(H2,’color’,’r’,’linewidth’ ,1); 
title(’Unweighted Ripples’ ,’fontsize’,TF,’vertical’,’baseline’) ; 

ylabel(’ Amplitude’ ,’vertical’,’cap’) 

xlabel(’Frequency in \pi units’, ’vertical’,’middle’) ; 


The responses of the designed FIR filter are given in Figure 9.25. This filter 
passes the signal spectrum over the passband [0, 7/2] without any distortion. 
However, since the transition width is not very narrow, it is possible that some 
of the signal over the transition band may alias into the band of interest. Also 
the 30 db attenuation may allow a small fraction of the signal spectrum from the 
stopband into the passband after downsampling. Therefore, we need a better 
approach for filter specifications, as discussed further along in this section. 


MATLAB Implementation As discussed, the upfirdn function can 
also be used for implementing the user-designed FIR filter in the decima- 
tion operation. When invoked as y = upfirdn(x,h,1,D), the function 
filters the signal data in the array x with the impulse response given in 
the array h and then downsamples the filtered data by the integer fac- 
tor D to produce the output array y, thus implementing the system in 
Figure 9.24. 


EXAMPLE 9.12 Using the filter designed in Example 9.11 decimate sinusoidal signals x(n) = 
cos(7n/8) and x2(n) = cos(7n/2) with frequencies within the passband of the 
filter. Verify the performance of the FIR filter and the results of the decimation. 


Solution The following MATLAB script provides the details. 
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FIGURE 9.25 Responses of the FIR decimation filter in Example 9.11 


% Given Parameters: 

D = 2; Rp = 0.1; As = 30; wp = pi/D; ws = wpt0O.1*pi; 

% Filter Design 

[delta1,delta2] = db2delta(Rp,As) ; 

[N,F,A,weights] = firpmord([wp,ws]/pi, [1,0], [delta1,delta2] ,2); 

h = firpm(N,F,A,weights); delay = N/2; % Delay imparted by the filter 


Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
>paperunits’,’inches’,’paperposition’,[0,0,6,4]); 


% Input signal x1(n) = cos(2*pi*n/16) 

n = [0:256]; x = cos(pixn/8) ; 

ni = n(1:33); x1 = x(33:65); % for plotting purposes 

subplot(2,2,1); Hs1 = stem(n1,x1,’filled’); set(Hs1,’markersize’ ,2,’color’,’g’); 
set (gca,’xtick’,[0:8:32],’ytick’,[-1,0,1]); 

axis([-2,34,-1.2,1.2]); ylabel(’Amplitude’); xlabel(’n’,’vertical’,’middle’) ; 
Title(’ Input Signal: x1(n) = cos(\pin/8)’,’fontsize’ ,TF,’vertical’,’baseline’) ; 


% Decimation of x1(n): D= 2 
y = upfirdn(x,h,1,D); 
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m = delay+1:1:128/Dtdelayt1; y = y(m); m = 0:16; y = y(16:32); 

subplot(2,2,3); Hs2 = stem(m,y,’filled’); set(Hs2,’markersize’ ,2,’color’,’m’); 
axis([-1,17,-1.2,1.2]); set (gca, *xtick’ ,[0:8:32]/D, ?ytick’, [=i i]s 
title(’Output signal: yi(n): D=2’,’fontsize’ ,IF,’vertical’,’baseline’) ; 
xlabel(’m’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


% Input signal x2(n) = cos(8*pi*n/16) 

n = [0:256]; x = cos(8*pi*n/(16)); 

ni = n(1:33); x1 = x(33:65); % for plotting purposes 

subplot(2,2,2); Hs1 = stem(n1,x1,’filled’); set(Hs1,’markersize’ ,2,’color’,’g’); 
set (gca,’xtick’,[0:8:32],’ytick’,[-1,0,1]); 

axis([-2,34,-1.2,1.2]); ylabel(’Amplitude’); xlabel(’n’,’vertical’,’middle’) ; 
Title(’ Input Signal: x2(m) = cos(\pin/2)’,’fontsize’ ,TF,’vertical’,’baseline’) ; 


% Decimation of x2(n): D= 2 

y = upfirdn(x,[h],1,D); %y = downsample(conv(x,h) ,2); 

m = delay+1:1:128/Dtdelayt1; y = y(m); m = 0:16; y = y(16:32); 

subplot(2,2,4); Hs2 = stem(m,y,’filled’); set(Hs2,’markersize’ ,2,’color’,’m’); 
axis([-1,17,-1.2,1.2]); set (gca, ’xtick’ ,[0:8:32]/D, ?ytick’, [=a 0, iJ) ))s 
title(’Output signal: y2(n): D=2’,’fontsize’ ,IF,’vertical’,’baseline’) ; 
xlabel(’m’,’vertical’,’middle’); ylabel(’ Amplitude’) ; 


The signal stem plots are shown in Figure 9.26. The leftside plots show the 
signal xı(n) and the corresponding decimated signal yi(n), and the rightside 
plots show the same for x2(n) and y2(n). In both cases the decimation appears 
to be correct. If we had chosen any frequency above 7/2, then the filter would 
have attenuated or eliminated the signal. 


9.5.4 DESIGN SPECIFICATIONS 
When we replace the ideal lowpass filter Hp(w) by a finite-order FIR filter 
H(w), we must allow for a transition band. Again we define 


e Wy,» as the signal bandwidth to be preserved 
e Wwy s as the frequency above which aliasing error is tolerated 


Then we have 0 < wrp < W2,s < T/D. If we choose wg, = T/D, then the 
decimator will give no aliasing error. If we choose wg s = Wz,), then the 
band above the signal band will contain aliasing errors. With these defini- 
tions and observations we can now specify the desired filter specifications. 
The filter must pass frequencies up to wz,», and its stopband must begin 
at (> — Wins) and continue up to m. Then, none of the k Æ 0 terms in 
(9.53)—.e., the “aliases,” will cause appreciable distortion in the band 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


FIR Filter Designs for Sampling Rate Conversion 513 


Input Signal: x1(n) = cos(zn/8) Input Signal: x2(n) = cos(zn/2) 


Amplitude 
Amplitude 


Output signal: y2(n): D = 2 


1 
© © 
me} ze} 
= =} 
os Z «OO 
€ £ 
< < 
z 
0 4 8 12 16 
m m 
FIGURE 9.26 Signal plots in Example 9.12 
up to wgs. Let 
2T 
Wp=Wrp and w= (F — wna) (9.56) 


be the passband and stopband edge frequencies, respectively, of the low- 
pass linear-phase FIR filter given in (9.51). Then we have the following 
filter design specifications: 


H,(w) < 1+ 6; for |w| € [0, wp] 
(9.57) 


H, (w) < 


ó> for |w| € [ws, 7] 


where wp and ws are as given in (9.56) and 6; and 62 are the passband and 
stopband ripple parameters of the lowpass FIR filter, respectively. Note 
that it does not matter what the spectrum X(w) is. We simply require 
that the product X(w)H(w) be very small beginning at w) = 27/D —wz,s 
so that k # 0 terms in (9.53) do not provide significant contribution in 
the band [—wyz,s,Wz,s], which is required to be free of aliasing. 
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Significance of 6; and 2 The filter ripple parameters 6, and 62 have 

the following significance, which must be taken into consideration while 

specifying their values: 

e The passband ripple 6; measures the ripple in the passband and hence 
controls the distortion in the signal bandwidth wy. 

e The stopband ripple 62 controls the amount of aliased energy (also 
called leakage) that gets into the band up to wy,5. 


There are (D — 1) contributions due to k # 0 terms in (9.53). These 
are expected to add incoherently (i.e., have peaks at different locations), 
so the overall peak error should be about 62. The actual error depends 
on how X(w) varies over the rest of the band |w| > wsp. Clearly, the 
filter stopband ripple 62 controls the aliasing error in the signal passband. 
Therefore, both 6; and ó> affect the decimated signal in its passband. 


Comment: Comparing the FIR decimator filter specifications (9.57) to 
those for the FIR interpolator in (9.52), we see a high degree of similarity. 
In fact, a filter designed to decimate by factor D can also be used to 
interpolate by the factor I = D, as we see from the following example. 
This means that the function intfilt can also be used to design FIR 
filters for decimation. 


EXAMPLE 9.13 ‘To design a decimate by D stage we need values for wz,,) and wz,s (remember 
that these are signal parameters). Assume wz,) = 1/(2D), which satisfies the 
constraint Wa,» < T/D and is exactly half the decimated bandwidth. Let wz, s = 
Wz,p. Then the FIR lowpass filter must pass frequencies up to wp = 7/(2D) and 
stop frequencies above ws = 2r /D — 1/(2D) = 3r /(2D). 

Now consider the corresponding interpolation problem. We want to inter- 
polate by J. We again choose wz,; = Wz,p, but now the range is wz,p < 7. If we 
take exactly half this band, we get wz,» = 1/2. Then according to the specifi- 
cations (9.52) for the interpolation, we want the filter to pass frequencies up to 
a/2I and to stop above 37/2/. Thus, for I = D, we have the same filter spec- 
ifications, so the same filter could serve both the decimation and interpolation 
problems. 


EXAMPLE 9.14 Design a decimation FIR filter for the signal x1(n) in Example 9.12 that has a 
better stopband attenuation of As = 50 dB and a lower filter order. 


Solution The signal bandwidth is wz,p = 7/8, and we will choose wz, = 7/D = 1/2. 
Then wp = 7/8 and ws = (27/D) — ws, = 7/2. With these parameters the 
optimum FIR filter length is 13, which is much lower than the previous one of 
37 with a higher attenuation. 


MATLAB script: 


% Given Parameters: 
D = 2; Rp = 0.1; As = 50; wxp = pi/8; wxs = pi/D; wp = wxp; ws = (2*pi/D)-wxs; 
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% Filter Design 

[delta1,delta2] = db2delta(Rp,As) ; 

[N,F,A, weights] firpmord([wp,ws]/pi, [1,0], [delta1,delta2],2); N = ceil(N/2)*2; 
h = firpm(N,F,A,weights); delay = N/2; % Delay imparted by the filter 


Hf1 = figure(’units’,’inches’,’position’,[1,1,6,4],... 
’paperunits’ ,’inches’ ,’paperposition’ ,[0,0,6,4]); 


% Input signal x(n) = cos(2*pi*n/16) 

n = [0:256]; x = cos(pi*n/8); 

ni = n(1:33); x1 = x(33:65); % for plotting purposes 

subplot(2,2,1); Hs1 = stem(n1,x1,’filled’); set(Hs1,’markersize’ ,2,’color’,’g’); 
set (gca,’xtick’,[0:8:32],’ytick’,[-1,0,1]); 

axis([-2,34,-1.2,1.2]); ylabel(’ Amplitude’, ’vertical’,’cap’); 
xlabel(’n’,’vertical’,’middle’); 

Title(’ Input Signal: x(n) = cos(\pin/8)’,’fontsize’,TF,’vertical’,’baseline’) ; 


% Decimation of x(n): D= 2 

y = upfirdn(x,h,1,D); 

m = delay+1:1:128/D+delay+1; y1 = y(m); m = 0:16; y1 = y1(14:30); 
subplot(2,2,3); Hs2 = stem(m,y1,’filled’); set(Hs2,’markersize’,2,’color’,’m’); 
axis([-1,17,-1.2,1.2]); set(gca,’?xtick’,[0:8:32]/D,’ytick’, [-1,0,1]); 
title(’Output signal y(n): D=2’,’fontsize’,TF,’vertical’,’baseline’) ; 
xlabel(’m’,’vertical’,’middle’); ylabel(’Amplitude’,’vertical’,’cap’); 


% Filter Design Plots 

[Hr,w,a,L] = Hr_Type1(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min); 
H = abs(freqz(h,1,w)); Hdb = 20*1log10(H/max(H)); min_attn = Hdb(w_min) ; 
subplot(2,2,2); plot(w/pi,Hr,’m’,’linewidth’,1.0); axis([0,1,-0.1,1.1]); 
set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[0,1]); grid; 

ylabel(’ Amplitude’, ’vertical’,’cap’); 

title(’ Amplitude Response’, ’fontsize’,TF,’vertical’,’baseline’) ; 
xlabel(’Frequency in \pi units’, ’vertical’,’middle’) ; 

subplot (2,2,4); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-60,10]); 
set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-60,round(min_attn) ,0]); grid 
ylabel(’Decibels’ ,’vertical’,’cap’); 

xlabel(’Frequency in \pi units’,’vertical’,’middle’); 
title(’Log-magnitude Response’ ,’fontsize’,TF,’vertical’,’baseline’) ; 


The signal stem plots and the filter responses are shown in Figure 9.27. The 
designed filter achieves an attenuation of 51 dB, and the decimated signal is 
correct. 
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FIGURE 9.27 Signal plots and filter design plots in Example 9.14 


9.5.5 FIR RATIONAL-FACTOR RATE CONVERSION 

Replacing the ideal filter of the system given on page 494 with an FIR 
filter H(w), we obtain the system shown in Figure 9.28. In this case the 
relevant ideal lowpass filter is given by (9.36), which is repeated here for 
convenience. 


I, 0 < |w| < min(7/D,7/T) 
H(w) = 9.58 
(a) i 0, otherwise ( ) 


For the signal x(n) we define 


Wgr,p as the signal bandwidth that should be preserved 
Wy,s, aS the overall signal bandwidth 
Wy,so as the signal bandwidth that is required to be free of aliasing error 


after resampling 


Then we have 


I 
0 < Wap < Wes. < = and = Was, <7 (9.59) 
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FIGURE 9.28 An FIR rational-factor resampler 


Now for the interpolation part, the lowpass filter must pass frequencies 
up to wr,p/I and attenuate frequencies starting at (27/I — wz,s,/I). The 
decimation part of the filter must again pass frequencies up to wg p/I 
but attenuate frequencies above (27/D — wz,s,/I). Therefore, the stop- 
band must start at the lower of these two values. Defining filter cutoff 
frequencies as 


27 Wes, 27 Wes, 
I I °D I 


(9.60) 


w 3 
Wp = (=) and ws = min 
I 


and the corresponding ripple parameters as 6, and 69, we have the fol- 
lowing filter specifications: 


THW) < 1464 for [ul € [0,9] 
(9.61) 
+ H(w) < +62 for |w| € [ws, 7] 


where H,(w) is the amplitude response. Note that if we set wss, = 7 and 
Wesa = Im/D, which are their maximum values, then we get the ideal 
cutoff frequency max|a/I,7/D], as given before in (9.36). 


MATLAB Implementation Clearly, the upfirdn function implements 
all the necessary operations needed in the rational sampling rate conver- 
sion system shown in Figure 9.28. When invoked as y = upfirdn(x,h, 
I,D), it performs a cascade of three operations: upsampling the input data 
array x by a factor of the integer I, FIR filtering the upsampled signal data 
with the impulse response sequence given in the array h, and finally down- 
sampling the result by a factor of the integer D. Using a well designed filter, 
we have a complete control over the sampling rate conversion operation. 


EXAMPLE 9.15 Design a sampling rate converter that increases the sampling rate by a factor of 
2.5. Use the firpm algorithm to determine the coefficients of the FIR filter that 
has 0.1 dB ripple in the passband and is down by at least 30 dB in the stopband. 
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Solution The FIR filter that meets the specifications of this problem is exactly the same 
as the filter designed in Example 9.8. Its bandwidth is 7/5. 


EXAMPLE 9.16 A signal x(n) has a total bandwidth of 0.97. It is resampled by a factor of 
4/3 to obtain y(m). We want to preserve the frequency band up to 0.87 and 
require that the band up to 0.77 be free of aliasing. Using the Parks-McClellan 
algorithm, determine the coefficients of the FIR filter that has 0.1 dB ripple in 
the passband and 40 dB attenuation in the stopband. 


Solution The overall signal bandwidth is wz,;, = 0.97, the bandwidth to be preserved is 
We,p = 0.87, and the bandwidth above which aliasing is tolerated is wz,s, = 0.77. 
From (9.60) and using J = 4 and D = 3, the FIR filter design parameters are 
Wp = 0.20 and ws = 0.2757. With these parameters, along with the passband 
ripple of 0.1 dB and stopband attenuation of 40 dB, the optimum FIR filter 
length is 58. The details and computation of design plots follow. 


% Given Parameters: 

I = 4; D = 3; Rp = 0.1; As = 40; 

wxp = 0.8*pi; wxsi = 0.9*pi; wxs2 = 0.7*pi; 

% Computed Filter Parameters 

wp = wxp/I; ws = min((2*pi/I-wxs1/I) , (2*pi/D-wxs2/1)) ; 

% Filter Design 

[deltai,delta2] = db2delta(Rp,As) ; 

(N,F,A,weights] = firpmord([wp,ws]/pi, [1,0] , [delta1,delta2] ,2); 

N = ceil(N/2)*2+1; h = firpm(N,F,1I*A,weights) ; 

Hf1 = figure(’units’,’inches’,’position’,[1,1,6,3],... 
>paperunits’,’inches’,’paperposition’,[0,0,6,3]); 

% Filter Design Plots 

{[Hr,w,a,L] = Ampl_res(h); Hr_min = min(Hr); w_min = find(Hr == Hr_min); 

H = abs(freqz(h,1,w)); Hdb = 20*1og10(H/max(H)); min_attn = Hdb(w_min) ; 

subplot(2,1,1); plot(w/pi,Hr,’m’,’linewidth’,1.0); axis(([0,1,-0.1,1+0.1]); 

set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[0,1]); grid; 

ylabel(’ Amplitude’, ’vertical’,’cap’); 

title(’ Amplitude Response’, ’fontsize’,TF,’vertical’,’baseline’) ; 

xlabel(’Frequency in \pi units’,’vertical’,’middle’) ; 

subplot(2,1,2); plot(w/pi,Hdb,’m’,’linewidth’,1.0); axis([0,1,-60,10]); 

set(gca,’xtick’,[0,wp/pi,ws/pi,1],’ytick’,[-60,round(min_attn) ,0]); grid 

ylabel(’Decibels’,’vertical’,’cap’); 

xlabel(’Frequency in \pi units’,’vertical’,’middle’) ; 

title(’Log-magnitude Response’ ,’fontsize’,TF,’vertical’,’baseline’) ; 


The filter responses are shown in Figure 9.29, which shows that the designed 
filter achieves the attenuation of 40 db. 
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FIGURE 9.29 The filter design plots in Example 9.16 


9.5.6 FIR FILTERS WITH MULTIPLE STOPBANDS 

We now discuss the use of multiple stopbands in the design of FIR in- 
teger interpolators when the low sampling rate is more than two times 
that required. Let us refer back to the Figure 9.22b on page 506, which 
illustrates a typical spectrum V(w) in integer interpolators. We could 
use a lowpass filter with multiple stopbands of bandwidth ws/I cen- 
tered at 2rk/I for k # 0. For I = 4, such a spectrum is shown in 
Figure 9.30(a), and the corresponding filter specifications are shown in 
Figure 9.30b. 

Clearly, these filter specifications differ from those given in (9.52) on 
page 506 in that the stopband is no longer one contiguous interval. Now 
if ws < 2/2, then there is a practical advantage to using this multiband 
design because it results in a lower order filter [2]. For m > ws > 7/2, 
the single-band lowpass filter specification (9.52) is easier and works as 
well. 

Similar advantages can be obtained for FIR integer decimators. We 
again find that we can substitute a multiple stopband lowpass filter for the 
single stopband design given in (9.57). With reference to the signal spec- 
ifications on page 513, we note that only part of the bands [r/D,37r/D], 
[37/D,57/D], ... etc. will get aliased into [—w,, +ws]. Therefore, the mul- 
tiple stopbands are given by [(27/D) — ws, (2a/D) + ws], [(4r/D) — ws, 
(42 /D) + ws], etc., centered at 27k/D, k #0. Once again there are prac- 
tical advantages when ws < 7/2M. 
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I 


FIGURE 9.30 Multiple stopband design: (a) signal spectrum, (b) filter specifica- 
tions 


9.6 FIR FILTER STRUCTURES FOR SAMPLING RATE CONVERSION 
—— g 


As indicated in the discussion in section 9.4, sampling rate conversion by 
a factor I/D can be achieved by first increasing the sampling rate by J, 
accomplished by inserting J — 1 zeros between successive values of the 
input signal x(n), followed by linear filtering of the resulting sequence to 
eliminate the unwanted images of X(w), and finally by downsampling the 
filtered signal by the factor D. In this section we consider the design and 
implementation of the linear filter. We begin with the simplest structure, 
which is the direct-form FIR filter structure, and develop its computation- 
ally efficient implementation. We then consider another computationally 
efficient structure called the polyphase structure, which is used in the im- 
plementation of the MATLAB functions resample and upfirdn. Finally, 
we close this section by discussing the time-variant filter structures for 
the general case of sampling rate conversion. 


9.6.1 DIRECT-FORM FIR FILTER STRUCTURES 
In principle, the simplest realization of the filter is the direct-form FIR 
structure with system function 


H(z) = So h(k)z* (9.62) 
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x(n) 


LD 


Downsampler 
Upsampler 


FIGURE 9.31 Direct-form realization of FIR filter in sampling rate conversion 
by a factor I/D 


where h(k) is the unit sample response of the FIR filter. After design- 
ing the filter as discussed in the previous section, we will have the filter 
parameters h(k), which allow us to implement the FIR filter directly, as 
shown in Figure 9.31. 

Although the direct-form FIR filter realization illustrated in 
Figure 9.31 is simple, it is also very inefficient. The inefficiency results 
from the fact that the upsampling process introduces J — 1 zeros between 
successive points of the input signal. If J is large, most of the signal 
components in the FIR filter are zero. Consequently, most of the multi- 
plications and additions result in zeros. Furthermore, the downsampling 
process at the output of the filter implies that only one out of every D 
output samples is required at the output of the filter. Consequently, only 
one out of every D possible values at the output of the filter should be 
computed. 

To develop a more efficient filter structure, let us begin with a deci- 
mator that reduces the sampling rate by an integer factor D. From our 
previous discussion, the decimator is obtained by passing the input se- 
quence x(n) through an FIR filter and then downsampling the filter out- 
put by a factor D, as illustrated in Figure 9.32a. In this configuration, 
the filter is operating at the high sampling rate Fy, while only one out of 
every D output samples is actually needed. The logical solution to this 
inefficiency problem is to embed the downsampling operation within the 
filter, as illustrated in the filter realization given in Figure 9.32b. In this 
filter structure, all the multiplications and additions are performed at the 
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FIGURE 9.32 Decimation by a factor D: (a) standard realization, (b) efficient 
realization 


lower sampling rate F,,/D. Thus, we have achieved the desired efficiency. 
Additional reduction in computation can be achieved by exploiting the 
symmetry characteristics of {h(k)}. Figure 9.33 illustrates an efficient re- 
alization of the decimator in which the FIR filter has linear phase and 
hence {h(k)} is symmetric. 

Next, let us consider the efficient implementation of an interpolator, 
which is realized by first inserting J — 1 zeros between samples of x(n) 
and then filtering the resulting sequence. The direct-form realization is 
illustrated in Figure 9.34. The major problem with this structure is that 
the filter computations are performed at the high sampling rate of IFz. 
The desired simplification is achieved by first using the transposed form 
of the FIR filter, as illustrated in Figure 9.35a, and then embedding the 
upsampler within the filter, as shown in Figure 9.35b. Thus, all the filter 
multiplications are performed at the low rate Fy, while the upsampling 
process introduces [—1 zeros in each of the filter branches of the structure 
shown in Figure 9.35b. The reader can easily verify that the two filter 
structures in Figure 9.35 are equivalent. 

It is interesting to note that the structure of the interpolator, shown 
in Figure 9.35b, can be obtained by transposing the structure of the deci- 
mator shown in Figure 9.32. We observe that the transpose of a decimator 
is an interpolator, and vice versa. These relationships are illustrated in 
Figure 9.36, where part b is obtained by transposing part a and part d is 
obtained by transposing part c. Consequently, a decimator is the dual of 
an interpolator, and vice versa. From these relationships, it follows that 
there is an interpolator whose structure is the dual of the decimator shown 
in Figure 9.33, which exploits the symmetry in h(n). 
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271 


FIGURE 9.33 Efficient realization of a decimator that exploits the symmetry in 
the FIR filter 


FIGURE 9.34 Direct-form realization of FIR filter in interpolation by a factor I 
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FIGURE 9.35 Efficient realization of an interpolator 


9.6.2 POLYPHASE FILTER STRUCTURE 

The computational efficiency of the filter structure shown in Figure 9.35 
can also be achieved by reducing the large FIR filter of length M into 
a set of smaller filters of length K = M/I, where M is selected to be a 
multiple of J. To demonstrate this point, let us consider the interpolator 
given in Figure 9.34. Since the upsampling process inserts J — 1 zeros 
between successive values of x(n), only K out of the M input values 
stored in the FIR filter at any one time are nonzero. At one time-instant, 
these nonzero values coincide and are multiplied by the filter coefficients 
h(0), h(I), h(2I),...,h(M — I). In the following time instant, the non- 
zero values of the input sequence coincide and are multiplied by the filter 
coefficients h(1),h(J + 1), A(2I +1), and so on. This observation leads us 


x(n) y(m) x(n) y(m) 
Input Output Output Input 
x(n) y(m) x(n) y(m) 
——>| TI tl H 
Input Output Output Input 


(c) (d) 
FIGURE 9.36 Duality relationships obtained through transpositions 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


FIR Filter Structures for Sampling Rate Conversion 525 


Rate: Fy = IF, 


FIGURE 9.37 Interpolation by use of polyphase filters 


to define a set of smaller filters, called polyphase filters, with unit sample 
responses 


pe(n) =h(k+ nl); k=0,1,...,2-1, n=0,1,...,K—1 (9.63) 


where K = M/I is an integer. 

From this discussion it follows that the set of I polyphase filters can 
be arranged as a parallel realization, and the output of each filter can be 
selected by a commutator, as illustrated in Figure 9.37. The rotation of 
the commutator is in the counterclockwise direction, beginning with the 
point at m = 0. Thus, the polyphase filters perform the computations at 
the low sampling rate Fp, and the rate conversion results from the fact 
that I output samples are generated, one from each of the filters, for each 
input sample. 

The decomposition of {h(k)} into the set of I subfilters with impulse 
response p(n), k = 0,1,...,—1 is consistent with our previous observa- 
tion that the input signal was being filtered by a periodically time-variant 
linear filter with impulse response 


g(n,m) = h(nI + (mD);) (9.64) 


where D = 1 in the case of the interpolator. We noted previously that 
g(n,m) varies periodically with period I. Consequently, a different set of 
coefficients is used to generate the set of J output samples y(m),m = 
0,1,...,f-1. 

Additional insight can be gained about the characteristics of the set 
of polyphase subfilters by noting that p(n) is obtained from h(n) by 
decimation with a factor I. Consequently, if the original filter frequency 
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response H(w) is flat over the range 0 < |w| < w/I, each of the polyphase 
subfilters possesses a relatively flat response over the range 0 < |w| < 7 
(i.e., the polyphase subfilters are basically allpass filters and differ pri- 
marily in their phase characteristics). This explains the reason for using 
the term polyphase in describing these filters. 

The polyphase filter can also be viewed as a set of I subfilters con- 
nected to a common delay line. Ideally, the kth subfilter will generate a 
forward time shift of (k/I)T,, for k = 0,1,2,...,I — 1, relative to the 
zeroth subfilter. Therefore, if the Oth filter generates zero delay, the fre- 
quency response of the kth subfilter is 

pr(w) = ef 
A time shift of an integer number of input sampling intervals (e.g., kT.) 
can be generated by shifting the input data in the delay line by J samples 
and using the same subfilters. By combining these two methods, we can 
generate an output that is shifted forward by an amount (k + i/ID)Te 
relative to the previous output. 

By transposing the interpolator structure in Figure 9.37, we obtain 
a commutator structure for a decimator based on the parallel bank of 
polyphase filters, as illustrated in Figure 9.38. The unit sample responses 
of the polyphase filters are now defined as 


pe(n) =h(k+nD); k=0,1,...,D—1, n=0,1,...,K—1 (9.65) 


where K = M/D is an integer when M is selected to be a multiple of 
D. The commutator rotates in a counterclockwise direction, starting with 
the filter po(n) at m = 0. 

Although the two commutator structures for the interpolator and the 
decimator just described rotate in a counterclockwise direction, it is also 
possible to derive an equivalent pair of commutator structures having a 
clockwise rotation. In this alternative formulation, the sets of polyphase 
filters are defined to have impulse responses 


pe(n) = h(nl—k), k=0,1,...,2-1 (9.66) 


and 
pe(n) = h(nD—k), k=0,1,...,D—1 (9.67) 


for the interpolator and decimator, respectively, 


EXAMPLE 9.17 For the decimation filter designed in Example 9.11, determine the polyphase 
filter coefficients {p;(m)} in terms of the FIR filter coefficients {h(n)} 


Solution The polyphase filters obtained from h(n) have impulse responses 


pk(n)=h(2n +k) k=0,1; n=0,1,...,14 
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Rate: F, 


Pi-4(N) 


Rate: Fy 


FIGURE 9.38 Decimation by use of polyphase filters 


Note that po(n) = h(2n) and pi(n) = h(2n + 1). Hence one filter consists of 
the even-numbered samples of h(n), and the other filter consists of the odd- 
numbered samples of h(n). 


EXAMPLE 9.18 For the interpolation filter designed in Example 9.8, determine the polyphase 
filter coefficients {px(n)} in terms of the filter coefficients {h(n)}. 


Solution The polyphase filters obtained from h(n) have impulse responses 


pe(n) = h(5n +k) k=0,1,2,3,4 


Consequently, each filter has length 6. 


9.6.3 TIME-VARIANT FILTER STRUCTURES 

Having described the filter implementation for a decimator and an inter- 
polator, let us now consider the general problem of sampling rate conver- 
sion by the factor I/D. In the general case of sampling rate conversion 
by a factor I/D, the filtering can be accomplished by means of the linear 
time-variant filter described by the response function 


g(n,m) = hint — ((mD))1] (9.68) 


where h(n) is the impulse response of the low-pass FIR filter, which 
ideally, has the frequency response specified by (9.36). For convenience 
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we select the length of the FIR filter {h(n)} to a multiple of I (ie., 
M = KI). As a consequence, the set of coefficients {g(n,m)} for each 
m = 0,1,2,...,£—1, contains K elements. Since g(n,m) is also periodic 
with period J, as demonstrated in (9.44), it follows that the output y(m) 
can be expressed as 


jie E (n.m—|™| 1)» (Ea -n) (9.69) 


Conceptually, we can think of performing the computations specified 
by (9.69) by processing blocks of data of length K by a set of K filter 
coefficients g(n,m — |m/I| I),n = 0,1,..., K — 1. There are I such sets 
of coefficients, one set for each block of I output points of y(m). For each 
block of I output points, there is a corresponding block of D input points 
of a(n) that enter in the computation. 

The block processing algorithm for computing (9.69) can be visual- 
ized as illustrated in Figure 9.39. A block of D input samples is buffered 
and shifted into a second buffer of length K, one sample at a time. The 
shifting from the input buffer to the second buffer occurs at a rate of 
one sample each time the quantity |mD/I| increases by one. For each 
output sample y(l), the samples from the second buffer are multiplied by 
the corresponding set of filter coefficients g(n,l) for n = 0,1,...,K — 1, 
and the K products are accumulated to give y(l), for l = 0,1,...,2—1. 


x(n) Coefficient Storage 


Input g(n, 0);0 <n <K -1 
Buffer of 


Length D 


Buffer of 
Length | 


FIGURE 9.39 Efficient implementation of sampling rate conversion by block 
processing 
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g (0, 4); t= 0,1 ys l-1 


FIGURE 9.40 Efficient realization of sampling rate conversion by a factor I/D 


Thus this computation produces J outputs. It is then repeated for a new 
set of D input samples, and so on. 

An alternative method for computing the output of the sampling rate 
converter, specified by (9.69), is by means of an FIR filter structure with 
periodically varying filter coefficients. Such a structure is illustrated in 
Figure 9.40. The input samples x(n) are passed into a shift register that 
operates at the sampling rate F, and is of length K = M/I, where M 
is the length of the time-invariant FIR filter specified by the frequency 
response given by (9.36). Each stage of the register is connected to a hold- 
and-sample device that serves to couple the input sampling rate Fy to 
the output sampling rate Fy = (I/D)F+. The sample at the input to each 
hold-and-sample device is held until the next input sample arrives and 
then is discarded. The output samples on the hold-and-sample device are 
taken at times mD/I,m = 0,1,2,.... When both the input and output 
sampling times coincide (i.e., when mD/T is an integer), the input to the 
hold-and-sample is changed first; then the output samples the new input. 
The K outputs from the K hold-and-sample devices are multiplied by 
the periodically time-varying coefficients g(n,m — |m/I] I), for n = 0, 
1,...,& —1, and the resulting products are summed to yield y(m). The 
computations at the output of the hold-and-sample devices are repeated 
at the output sampling rate of F = (I/D) Fy. 

Finally, rate conversion by a rational factor I/D can also be performed 
by use of a polyphase filter having J subfilters. If we assume that the mth 
sample y(m) is computed by taking the output of the imth subfilter with 
input data x(n),a(n — 1),...,a(n — K +1), in the delay line, the next 
sample y(m + 1) is taken from the (¢m41)st subfilter after shifting lm+1 
new samples in the delay lines where im41 = (im + D)moq z and lm+1 is 
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the integer part of (im + D)/I. The integer im+ı should be saved to be 
used in determining the subfilter from which the next sample is taken. 


EXAMPLE 9.19 For the sampling rate converter designed in Example 9.15, specify the set of 
time-varying coefficients {g(n, m)} used in the realization of the converter based 
on the structure given in Figure 9.19. Also, specify the corresponding implemen- 
tation based in polyphase filters. 


Solution The coefficients of the filter are given by (9.43) 
D 
g(n,m) = h(nI + (mD)7) =h (n1 +mD— [7m] 1) 
By substituting J = 5 and D = 2, we obtain 
2m 
g(n,m) =h (5n + 2m — 5 (Œ) 
By evaluating g(n,m) for n = 0,1,...,5 and m = 0,1,....,4 we obtain the 
following coefficients for the time-variant filter: 
g(0,m) = {h(0) h(2) h(4) AC) R(3)} 
g(1,m) ={h(5) h(7) A(9) A(6) A(8)} 
g(2,m) = {h(10) h(12) h(14) h(11) h(13)} 
g(3,m) = {h(15) h(17) h(19) h(16) h(18)} 
g(4,m) = {h(20) h(22) h(24) h(21) h(23)} 
g(5,m) = {h(25) h(27) h(29) h(26) h(28)} 
A polyphase filter implementation would employ five subfilters, each of length 


six. To decimate the output of the polyphase filters by a factor of D = 2 simply 
means that we take every other output from the polyphase filters. Thus, the first 
output y(0) is taken from po(n), the second output y(1) is taken from p(n), 
the third output is taken from p(n), the fourth output is taken from p1(n), the 
fifth output is taken from p3(n), and so on. 


9.7 PROBLEMS 
—— g 


P9.1 Consider the upsampler with input x(n) and output v(m) given in (9.26). Show that the 
upsampler is a linear but time-varying system. 


P9.2 Let x(n) = 0.9"u(n). The signal is applied to a downsampler that reduces the rate by a 
factor of 2 to obtain the signal y(m). 


1. Determine and plot the spectrum X (w). 
2. Determine and plot the spectrum Y (w). 
3. Show that the spectrum in part (2) is simply the DTFT of x(2n). 
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P9.3 Consider a signal with spectrum 


_ J nonzero, |w| < wo; 
ez { 0, wo < w| <T. 


1. Show that the signal x(n) can be recovered from its samples x(mD) if the sampling 


frequency ws 2 2r/D > Quo. 
2. Sketch the spectra of x(n) and z(mD) for D = 4. 
3. Show that x(n) can reconstructed from the bandlimited interpolation 


co 


x(n) = 5 x(kD) sinc|fe(n — kD)]; wo < 2r fe < ws — wo, fe = £ 


k=— o0 


dv 


P9.4 Using the function downsample, study the operation of factor-of-4 downsampling on the 
following sequences. Use the stem function to plot the original and the downsampled 
sequences. Experiment using the default offset value of zero and the offset value equal to 2. 
Comment on any differences. 


1. x1(n) = cos(0.157n), 0 < n < 100 

2. x2(n) = sin(0.1rn) + sin(0.4rn), 0 < n < 100 

3. x3(n) = 1 — cos(0.257n), 0 < n < 100 

4. xa(n)=0.1n, 0 <n < 100 

5. x5(n) = {0, 1, 2, 3, 4, 5, 4, 3, 2, 1}pERIODIC, 0 <n< 100 


P9.5 Repeat Problem P9.4 using the factor-of-5 downsampler. 


P9.6 Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0.5 at w = 0, 1 at w = 0.17, 1 at w = 0.2, 0 at w = 0.227, and 0 at 
w=rT. 


1. Compute and plot the DTFT magnitude of x(n). 

Downsample x(n) by a factor of 2, and plot the DTFT of the resulting sequence. 
Downsample x(n) by a factor of 4, and plot the DTFT of the resulting sequence. 
Downsample x(n) by a factor of 5, and plot the DTFT of the resulting sequence. 
Comment on your results. 


CE Soe 


P9.7 Using the function decimate, study the operation of factor-of-4 decimation on the 
following sequences. Use the stem function to plot the original and the decimated 
sequences. Experiment, using both the default IIR and FIR decimation filters. Comment 
on any differences. 

1. x(n) = sin(0.157n), 0 < n < 100 

2. x2(n) = cos(0.17n) + cos(0.47n), 0 < n < 100 

3. 23(n) = 1 — cos(0.257n), 0 < n < 100 

4. va(n) =0.1n, 0 <n < 100 

5. X5(n) = {0, 1, 2; 3, 4, 5; 4, 3, 2, 1}pERIODIC; 0 & n < 100 


P9.8 Repeat Problem P9.7 using the 4th-order IIR filter and the 15th-order FIR decimation 
filters. Comment on any performance differences. 


P9.9 Repeat Problem P9.7 using the factor-of-5 decimation. Comment on any differences. 


P9.10 Repeat Problem P9.9 using the the 4th-order IIR filter and the 15th-order FIR decimation 
filters. Comment on any differences. 
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P9.11 Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0.5 at w = 0, 1 at w = 0.17, 1 at w = 0.2, 0 at w = 0.227, and 0 at 
W=T. 


1. Compute and plot the DTFT of x(n). 

Decimate x(n) by a factor of 2, and plot the DTFT of the resulting sequence. 
Decimate x(n) by a factor of 4, and plot the DTFT of the resulting sequence. 
Decimate x(n) by a factor of 5, and plot the DTFT of the resulting sequence. 
Comment on your results. 


OU OS 


P9.12 Using the function upsample, study the operation of factor-of-4 upsampling on the 
following sequences. Use the stem function to plot the original and the upsampled 
sequences. Experiment using the default offset value of zero and the offset value 
equal to 2. 


= sin(0.67n), 0 < n < 100 
n) = sin(0.87n) + cos(0.5rn), 0 < n < 100 
=1 


1. xı 
2. £2 
3. x3(n) + cos(mn), 0 < n < 100 
4. x4 

5 


Sse 


P9.13 Using the fir2 function, generate a 91-length sequence x(n) whose frequency-domain 
sampled values are 0 at w = 0, 0.5 at w = 0.17, 1 at w = 0.2, 1 at w = 0.77, 0.5 at 
w = 0.757, 0 at w = 0.87, and 0 at w = r. 


1. Compute and plot the DTFT magnitude of x(n). 

2. Upsample x(n) by a factor of 2, and plot the DIFT magnitude of the resulting 
sequence. 

3. Upsample x(n) by a factor of 3, and plot the DTFT magnitude of the resulting 
sequence. 

4. Upsample x(n) by a factor of 4, and plot the DTFT magnitude of the resulting 
sequence. 

5. Comment on your results. 


P9.14 Using the function interp, study the operation of factor-of-4 interpolation on the 
sequences of Problem P9.12. Use the stem function to plot the original and the 
interpolated sequences. Experiment, using the filter length parameter values equal to 3 
and 5. Comment on any differences in performance of the interpolation. 


P9.15 Provide the frequency response plots of the lowpass filters used in the interpolators of 
Problem P9.14. 


P9.16 Repeat Problem P9.14, using the factor-of-3 interpolation. 


P9.17 Provide the frequency response plots of the lowpass filters used in the interpolators of 
Problem P9.16. 


P9.18 Repeat Problem P9.14, using the factor-of-5 interpolation. 


P9.19 Provide the frequency response plots of the lowpass filters used in the interpolators of 
Problem P9.18. 


P9.20 Using the fir2 function generate a 91-length sequence x(n) whose frequency-domain 
sampled values are 0 at w = 0, 0.5 at w = 0.17, 1 at w = 0.2, 1 at w = 0.77, 0.5 at 
w = 0.757, 0 at w = 0.87, and 0 at w = T. 
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Compute and plot the DTFT of x(n). 

Interpolate x(n) by a factor of 2, and plot the DTFT of the resulting sequence. 
Interpolate x(n) by a factor of 3, and plot the DTFT of the resulting sequence. 
Interpolate x(n) by a factor of 4 and plot the DTFT of the resulting sequence. 
Comment on your results. 


CUS Nae 


P9.21 Consider two sequences xı(n) and x2(n), which appear to be related. 
x1(n) = max (10 — |n|,0) and = we(n) = min (|n|, 10) 


Use the resample function with default parameters. 


1. Resample the sequence x1(n) at 3/2 times the original rate to obtain yi(m), and 
provide the stem plots of both sequences. 

2. Resample the sequence x2(n) at 3/2 times the original rate to obtain y2(m), and 
provide the stem plots of both sequences. 

3. Explain why the resampled plot of y2(n) has inaccuracies near the boundaries that 
yi(n) does not have. 

4. Plot the frequency response of the filter used in the resampling operation. 


P9.22 Let x(n) = cos(0.17n) + 0.5 sin(0.27n) + 0.25 cos(0.47n). Use the resample function with 
default parameters. 


1. Resample the sequence x(n) at 4/5 times the original rate to obtain yi(m), and provide 
the stem plots of both sequences. 

2. Resample the sequence x(n) at 5/4 times the original rate to obtain y2(m), and provide 
the stem plots of both sequences. 

3. Resample the sequence x(n) at 2/3 times the original rate to obtain y3(m), and provide 
the stem plots of both sequences. 

4. Explain which of the three output sequences retain the “shape” of the original sequence 


P9.23 Let x(n) = {0,0,0, 1,1, 1,1,0,0, 0}pErropic be a periodic sequence with period 10. Use 
the resample function for the following parts to resample the sequence x(n) at 3/5 times 
the original rate. Consider the length of the input sequence to be 80. 


1. Use the filter length parameter L equal to zero to obtain yi(m) and provide the stem 
plots of x(n) and yi(m) sequences. 

2. Use the default value of the filter length parameter L to obtain y2(m) and provide the 
stem plots of x(n) and y2(m) sequences. 

3. Use the filter length parameter L equal to 15 to obtain y3(m) and provide the stem 
plots of x(n) and y3(m) sequences. 


P9.24 Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0 at w = 0, 0.5 at w = 0.17, 1 at w = 0.27, 1 at w = 0.57, 0.5 at 
w = 0.557, 0 at w = 0.67, and 0 at w = T. 


1. Compute and plot the DTFT of x(n). 

Resample x(n) by a factor of 4/3, and plot the DTFT of the resulting sequence. 
Resample x(n) by a factor of 3/4, and plot the DTFT of the resulting sequence. 
Resample x(n) by a factor of 4/5, and plot the DTFT of the resulting sequence. 
Comment on your results. 


OL Er 
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P9.25 We want to design a linear-phase FIR filter to increase the input sampling rate by a factor 
of 3 using the intfilt function. 


1. Assuming full bandwidth of the signal to be interpolated, determine the impulse 
response of the required FIR filter. Plot its amplitude response and the log-magnitude 
response in dB. Experiment with the length parameter L to obtain a reasonable 
stopband attenuation. 

2. Assuming that bandwidth of the signal to be interpolated is 7/2, determine the 
impulse response of the required FIR filter. Plot its amplitude response and the 
log-magnitude response in decibels. Again experiment with the length parameter L to 
obtain a reasonable stopband attenuation. 


P9.26 We want to design a linear-phase FIR filter to increase the input sampling rate by a factor 
of 5 using the intfilt function. 


1. Assuming full bandwidth of the signal to be interpolated, determine the impulse 
response of the required FIR filter. Plot its amplitude response and the log-magnitude 
response in decibels. Experiment with the length parameter L to obtain a reasonable 
stopband attenuation. 

2. Assuming that bandwidth of the signal to be interpolated is 47/5, determine the 
impulse response of the required FIR filter. Plot its amplitude response and the 
log-magnitude response in decibels. Again experiment with the length parameter L to 
obtain a reasonable stopband attenuation. 


P9.27 Using the Parks-McClellan algorithm, design an interpolator that increases the input 
sampling rate by a factor of I = 2. 


1. Determine the coefficients of the FIR filter that has 0.5 dB ripple in the passband and 
50 dB attenuation in the stopband. Choose reasonable values for the band-edge 
frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

Determine the corresponding polyphase structure for implementing the filter. 

4. Let x(n) = cos(0.47n). Generate 100 samples of x(n), and process it using this filter to 
interpolate by I = 2 to obtain y(m). Provide the stem plots of the both sequences. 


P9.28 Using the Parks-McClellan algorithm, design an interpolator that increases the input 
sampling rate by a factor of J = 3. 


1. Determine the coefficients of the FIR filter that has 0.1 dB ripple in the passband and 
40 dB attenuation in the stopband. Choose reasonable values for the band-edge 
frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

Determine the corresponding polyphase structure for implementing the filter. 

4. Let x(n) = cos(0.37n). Generate 100 samples of x(n) and process it using this filter to 
interpolate by I = 3 to obtain y(m). Provide the stem plots of both sequences. 


teas 


P9.29 A signal x(n) is to be interpolated by a factor of 3. It has a bandwidth of 0.47, but we 
want to preserve frequency band up to 0.37 in the interpolated signal. Using the 
Parks-McClellan algorithm, we want to design such an interpolator. 


1. Determine the coefficients of the FIR filter that has 0.1 dB ripple in the passband and 
40 dB attenuation in the stopband. 
2. Provide plots of the impulse and the log-magnitude responses. 
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3. Let x(n) = cos(0.37n) + 0.5 sin(0.47n). Generate 100 samples of x(n), and process it 
using this filter to interpolate by I = 3 to obtain y(m). Provide the stem plots of both 
sequences. 


P9.30 A signal x(n) is to be interpolated by a factor of 4. It has a bandwidth of 0.77, but we 
want to preserve frequency band up to 0.67 in the interpolated signal. Using the 
Parks-McClellan algorithm, we want to design such an interpolator. 


1. Determine the coefficients of the FIR filter that has 0.5 dB ripple in the passband and 
50 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Let x(n) = sin(0.57n) + cos(0.77n). Generate 100 samples of x(n) and process it using 
this filter to interpolate by J = 4 to obtain y(m). Provide the stem plots of both 
sequences. 


P9.31 Using the Parks-McClellan algorithm, design a decimator that downsamples an input 
signal x(n) by a factor of D = 5. 


1. Determine the coefficients of the FIR filter that has 0.1 dB ripple in the passband and 
30 dB attenuation in the stopband. Choose reasonable values for the band-edge 
frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

Determine the corresponding polyphase structure for implementing the filter. 

4. Using the fir2 function, generate a 131-length sequence x(n) whose frequency-domain 
sampled values are 1 at w = 0, 0.9 at w = 0.17, 1 at w = 0.27, 1 at w = 0.57, 0.5 at 
w = 0.557, 0 at w = 0.67, and 0 at w = r. Process x(n) using this filter to decimate it 
by a factor of 5 to obtain y(m). Provide the spectral plots of both sequences. 


wo 


P9.32 Using the Parks-McClellan algorithm, design a decimator that downsamples an input 
signal x(n) by a factor of D = 3. 


1. Determine the coefficients of the FIR filter that has 0.5 dB ripple in the passband and 
30 dB attenuation in the stopband. Choose reasonable values for the band-edge 
frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Let x1(n) = sin(0.27n) + 0.2 cos(0.57n). Generate 500 samples of zı (n), and process it 
using this to decimate by D = 3 to obtain yi(m). Provide the stem plots of both 
sequences. 

4. Using the fir2 function, generate a 131-length sequence x2(n) whose frequency-domain 
sampled values are 1 at w = 0, 0.8 at w = 0.157, 1 at w = 0.37, 1 at w = 0.47, 0.5 at 
w = 0.457, 0 at w = 0.57, and 0 at w = r. Process x2(n), using this filter to decimate it 
by a factor of 3 to obtain y2(m). Provide the spectral plots of both sequences. 


P9.33 A signal x(n) is to be decimated by a factor of D = 2. It has a bandwidth of 0.47, and we 
will tolerate aliasing this frequency 0.457 in the decimated signal. Using the 
Parks-McClellan algorithm, we want to design such a decimator. 


1. Determine the coefficients of the FIR filter that has 0.1 dB ripple in the passband and 
45 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Let x1(m) = cos(0.4rn) + 2 sin(0.457n). Generate 200 samples of x1(n), and process it 
using this filter to decimate by D = 2 to obtain y1(m). Provide the stem plots of both 
sequences. 
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4. Using the fir2 function, generate a 151-length sequence x2(n) whose frequency-domain 
sampled values are 1 at w = 0, 0.9 at w = 0.27, 1 at w = 0.47, 0.5 at w = 0.457, 0 at 
w = 0.57, and 0 at w = 7. Process x2(n), using this filter to decimate it by a factor of 2 
to obtain y2(m). Provide the spectral plots of both sequences. 


P9.34 A signal x(n) is to be decimated by a factor of D = 3. It has a bandwidth of 0.257, and we 
will tolerate aliasing this frequency 0.37 in the decimated signal. Using the 
Parks-McClellan algorithm, we want to design such a decimator. 


1. Determine the coefficients of the FIR filter that has 0.1 dB ripple in the passband and 
40 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Let xı(n) = cos(0.2mn) + 2sin(0.37n). Generate 300 samples of x1(n), and process it 
using this filter to decimate by D = 3 to obtain y1(m). Provide the stem plots of both 
sequences. 

4. Using the fir2 function, generate a 151-length sequence x2(n) whose frequency-domain 
sampled values are 1 at w = 0, 1 at w = 0.17, 1 at w = 0.257, 0.5 at w = 0.37, 0 at 
w = 0.357, and 0 at w = 7. Process r2(n), using this filter to decimate it by a factor of 
3 to obtain y2(m). Provide the spectral plots of both sequences. 


P9.35 Design a sampling rate converter that reduces the sampling rate by a factor of 2/5. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.1 dB ripple in the passband and 30 dB attenuation in the stopband. Choose 
reasonable values for the band-edge frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Specify the sets of the time-varying coefficients g(m,n) and the corresponding 
coefficients in the polyphase filter realization. 

4. Let x(n) = sin(0.357n) + 2.cos(0.457n). Generate 500 samples of x(n) and process it 
using this filter to resample by 2/5 to obtain y(m). Provide the stem plots of both 
sequences. 


P9.36 Design a sampling rate converter that increases the sampling rate by a factor of 7/4. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.1 dB ripple in the passband and 40 dB attenuation in the stopband. Choose 
reasonable values for the band-edge frequencies. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Specify the sets of the time-varying coefficients g(m,n) and the corresponding 
coefficients in the polyphase filter realization. 

4. Let x(n) = 2sin(0.357n) + cos(0.957n). Generate 500 samples of x(n) and process it, 
using this filter to resample by 7/4 to obtain y(m). Provide the stem plots of both 
sequences. 


P9.37 A signal x(n) is to be resampled by a factor of 3/2. It has a total bandwidth of 0.87, but 
we want to preserve frequencies only up to 0.67 and require that the band up to 0.757 be 
free of aliasing in the resampled signal. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.5 dB ripple in the passband and 50 dB attenuation in the stopband. 
2. Provide plots of the impulse and the log-magnitude responses. 
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3. Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0.7 at w = 0, 1 at w = 0.37, 1 at w = 0.77, 0.5 at w = 0.757, 0 at 
w = 0.87, and 0 at w = 7. Process x(n) using this filter to resample it by 3/2 to obtain 
y(m). Provide the spectral plots of both sequences. 


P9.38 A signal x(n) is to be resampled by a factor of 4/5. It has a total bandwidth of 0.87, but 
we want to preserve frequencies only up to 0.57 and require that the band up to 0.757 be 
free of aliasing in the resampled signal. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.1 dB ripple in the passband and 40 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0.7 at w = 0, 1 at w = 0.32, 1 at w = 0.77, 0.5 at w = 0.757, 0 at 
w = 0.87, and 0 at w = 7. Process x(n), using this filter to resample it by 4/5 to obtain 
y(m). Provide the spectral plots of both sequences. 


P9.39 A signal x(n) is to be resampled by a factor of 5/2. It has a total bandwidth of 0.87, but 
we want to preserve frequencies only up to 0.7m and require that the band up to 0.757 be 
free of aliasing in the resampled signal. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.5 dB ripple in the passband and 50 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 0.7 at w = 0, 1 at w = 0.37, 1 at w = 0.77, 0.5 at w = 0.757, 0 at 
w = 0.87, and 0 at w = r. Process x(n) using this filter to resample it by a 5/2 to 
obtain y(m). Provide the spectral plots of both sequences. 


P9.40 A signal x(n) is to be resampled by a factor of 3/8. It has a total bandwidth of 0.57, but 
we want to preserve frequencies only up to 0.37 and require that the band up to 0.357 be 
free of aliasing in the resampled signal. 


1. Using the Parks-McClellan algorithm, determine the coefficients of the FIR filter that 
has 0.1 dB ripple in the passband and 40 dB attenuation in the stopband. 

2. Provide plots of the impulse and the log-magnitude responses. 

3. Using the fir2 function, generate a 101-length sequence x(n) whose frequency-domain 
sampled values are 1 at w = 0, 1 at w = 0.257, 1 at w = 0.57, 0.5 at w = 0.557, 0 at 
w = 0.67, and 0 at w = 7. Process x(n) using this filter to resample it by 3/8 to obtain 
y(m). Provide the spectral plots of both sequences. 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


CHAPTER 10 


Round-off Effects 
in Digital Filters 


In the latter part of Chapter 6 we discussed the finite-precision num- 
ber representations for the purpose of implementing filtering operations 
on digital hardware. In particular, we focused on the process of number 
quantization, the resulting error characterizations, and the effects of fil- 
ter coefficient quantization on filter specifications and responses. In this 
chapter, we further extend the effects of finite-precision numerical effects 
to the filtering aspects in signal processing. 

We begin by discussing analog-to-digital (A/D) conversion noise us- 
ing the number representations and quantization error characteristics de- 
veloped in Chapter 6. We then analyze the multiplication and addition 
quantization (collectively known as arithmetic round-off error) models. 
The effects of these errors on filter output are discussed as two topics: 
correlated errors called limit cycles and uncorrelated round-off noise. 


10.1 ANALYSIS OF A/D QUANTIZATION NOISE 
ee 


From the quantizer characteristics obtained in Chapter 6, it is obvious 
that the quantized value Q[x] is a nonlinear operation on the value z7. 
Hence the exact analysis of the finite word-length effects in digital filters 
is generally difficult and one has to consider less ideal analysis techniques 
that work well in practice. 

One such technique is the statistical modeling technique. It converts 
the nonlinear analysis problem into a linear one and allows us to examine 


538 
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x(n) —— QUANTIZER J ovo => a 
e(n) 


FIGURE 10.1 Statistical model of a quantizer 


output-error characteristics. In this technique, we assume that the quan- 
tized value Q[z] is a sum of the exact value x and the quantization error e, 
which is assumed to be a random variable. When x(n) is applied as an 
input sequence to the quantizer, the error e(n) is assumed to be a random 
sequence. We then develop a statistical model for this random sequence 
to analyze its effects through a digital filter. 

For the purpose of analysis, we assume that the quantizer employs 
fixed-point two’s-complement number format representation. Using the 
results given previously, we can extend this analysis to other formats as 
well. 


10.1.1 STATISTICAL MODEL 
We model the quantizer block on the input as a signal-plus-noise 
operation—that is, from (6.46) 


Ola(n)] = x(n) + eln) (10.1) 


where e(n) is a random sequence that describes the quantization error se- 
quence and is termed the quantization noise. This is shown in Figure 10.1. 


Model assumptions For the model in (10.1) to be mathematically 
convenient and hence practically useful, we have to assume reasonable 
statistical properties for the sequences involved. That these assumptions 
are practically reasonable can be ascertained using simple MATLAB ex- 
amples, as we shall see. We assume that the error sequence, e(n) has the 
following characteristics:+ 


1. The sequence e(n) is a sample sequence from a stationary random 
process {e(n)}. 

2. This random process {e(n)} is uncorrelated with sequence x(n). 

3. The process {e(n)} is an independent process (i.e., the samples are 
independent of each other). 

4. The probability density function (pdf), fz(e), of sample e(n) for each 
n is uniformly distributed over the interval of width A = 272, which 
is the quantizer resolution. 


1We assume that the reader is familiar with the topic of random variables and processes 
and the terminology associated with it. 
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These assumptions are reasonable in practice if the sequence x(n) is suf 
ficiently random to traverse many quantization steps in going from time 
nton+l. 


10.1.2 ANALYSIS USING MATLAB 

To investigate the statistical properties of the error samples, we will have 
to generate a large number of these samples and plot their distribution 
using a histogram (or a probability bar graph). Furthermore, we have to 
design the sequence x(n) so that its samples do not repeat; otherwise, the 
error samples will also repeat, which will result in an inaccurate analy- 
sis. This can be guaranteed either by choosing a well-defined aperiodic 
sequence or a random sequence. 

We will quantize x(n) using B-bit rounding operation. A similar im- 
plementation can be developed for the truncation operation. Since all 
three error characteristics are exactly the same under the rounding op- 
eration, we will choose the sign-magnitude format for ease in implemen- 
tation. After quantization, the resulting error samples e(n) are uniformly 
distributed over the |- $, 4] interval. Let e;(n) be the normalized error 
given by 


e(n) =) = ony 28 > e1(n) €[-1/2,1/2] (10.2) 


Then e;(n) is uniform over the interval [—5, +5], as shown in Figure 10.2a. 
Thus the histogram interval will be uniform across all B-bit values, which 
will make its computation and plotting easier. This interval will be divided 
into 128 bins for the purpose of plotting. 

To determine the sample independence we consider the histogram of 


the sequence 


sles = = (10.3) 


which is the average of two consecutive normalized error samples. If 
e(n) is uniformly distributed between [—1/2,1/2], then, for sample 
independence, e2(n) must have a triangle-shaped distribution between 
[—1/2,1/2], as shown in Figure 10.2b. We will again generate a 128- 
bin histogram for e2(n). These steps are implemented in the following 
MATLAB function. 


e,(n) e,(n) 


-1/2 1/2 -1/2 1/2 


FIGURE 10.2 Probability distributions of the normalized errors e(n) and e2(n) 
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function [H1,H2,Q, estat] = StatModelR(xn,B,N); 

% Statistical Model (Rounding) for A/D Quantization error and its Distribution 
Oh rea ng eA ee ee ee 
% (H1,H2,Q] = StatModelR(xn,B,N); 

% OUT: H1 = Normalized histogram of e1 


h H2 = Normalized histogram of e2 
h Q = Normalized histogram bins 
h estat = row vector: [[elavg,eistd,e2avg,e2std] 
h IN: B = bits to quantize 
ib N = number of samples of x(n) 
h xn = samples of the sequence 
% Plot variables 
bM = 7; DbM = 27bM; % bin parameter 
M = round((DbM) /2) ; ù% Half number of bins 
bins = [-M+0.5:1:M-0.5]; ù% Bin values from -M to M 
Q = bins/(DbM) ; % Normalized bins 
% Quantization error analysis 
xq = (round(xn*(27B)))/(27B) ; % Quantized to B bits 
el = xq-xn; clear xn xq; %, Quantization error 
e2 = 0.5*(e1(1:N-1)+e1(2:N)); % Average of two adj errors 
elavg = mean(el); elstd = std(el); %, Mean & std dev of the error el 
e2avg = mean(e2); e2std = std(e2); i, Mean & std dev of the error e2 


estat = [elavg,elstd,e2avg,e2std] ; 
% Probability distribution of e1 


el = floor(e1*(27 (B+bM) )); % Normalized e1 (int between -M & M) 
el = sort([e1,-M-1:1:M]); h 
Hi = diff (find(diff(e1)))-1; clear e1; % Error histogram 


if length(H1) == DbM+1 
H1(DbM) = H1(DbM)+H1(DbM+1); 
Hi = H1(1:DbM); 


end 
H1 = H1/N; % Normalized histogram 
% Probability distribution of e2 
e2 = floor(e2* (27 (B+bM) )); % Normalized e2 (int between -M & M) 
e2 = sort([e2,-M-1:1:M]); h 
H2 = diff (find(diff(e2)))-1; clear e2; % Error histogram 


if length(H2) == DbM+1 
H2(DbM) = H2(DbM)+H2(DbM+1) ; 
H2 = H2(1:Db™) ; 
end 
H2 = H2/N; % Normalized histogram 


To validate the model assumptions, we consider the following two ex- 
amples. In the first example an aperiodic sinusoidal sequence is quantized 
to B bits, and in the second example a random sequence is quantized to B 
bits. The resulting quantization errors are analyzed for their distribution 
properties and for their sample independence for various values of B. 
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FIGURE 10.3 A/D quantization error distribution for the sinusoidal signal in 
Example 10.1, B = 2 bits 


Through these examples we hope to learn how small error e must be (or 
equivalently, how large B must be) for the above assumptions to be valid. 


EXAMPLE 10.1 Let x(n) = ${sin(n/11) + sin(n/31) + cos(n/67)}. This sequence is not peri- 
odic, and hence its samples never repeat using infinite-precision representation. 
However, since the sequence is of sinusoidal nature, its continuous envelope is 
periodic and the samples are continuously distributed over the fundamental 
period of this envelope. Determine the error distributions for B = 2 and 6 bits. 


Solution To minimize statistical variations, the sample size must be large. We choose 
500,000 samples. The following MATLAB script computes the distributions for 
B = 2 bits. 


clear; close all; 

%⁄ Example parameters 

B = 2; N = 500000; n = [1:N]; 

xn = (1/3)*(sin(n/11)+sin(n/31)+cos(n/67)); clear n; 

% Quantization error analysis 

[H1,H2,Q, estat]] = StatModelR(xn,B,N); % Compute histograms 
Himax = max(Hi); Himin = min(H1); % Max and Min of H1 

H2max = max(H2); H2min = min(H2); % Max and Min of H2 


The plots of the resulting histogram are shown in Figure 10.3. Clearly, even 
though the error samples appear to be uniformly distributed, the samples 
are not independent. The corresponding plots for B = 6 bits are shown in 
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FIGURE 10.4 Quantization error distribution for the sinusoidal signal in 
Example 10.1, B = 6 bits 


Figure 10.4, from which we observe that the quantization error sequence ap- 
pears to satisfy the model assumptions for B > 6 bits. 


EXAMPLE 10.2 Let x(n) be an independent and identically distributed random sequence whose 
samples are uniformly distributed over the [—1, 1] interval. Determine the error 
distributions for B = 2 and 6 bits. 


Solution We again choose 500,000 samples to minimize any statistical variations. The 
following MATLAB fragment computes the distributions for B = 2 bits. 


clear; close all; 

% Example parameters 

B = 2; N = 500000; xn = (2*rand(1,N)-1); 

% Quantization error analysis 

[H1,H2,Q, estat]] = StatModelR(xn,B,N); % Compute histograms 
Himax = max(Hi); Himin = min(H1); % Max and Min of H1 

H2max = max(H2); H2min = min(H2); % Max and Min of H2 


The plots of the resulting histogram are shown in Figure 10.5. The correspond- 
ing plots for B = 6 bits are shown in Figure 10.6. From these plots we observe 
that even for B = 2 bits the quantization error samples are independent and 
uniformly distributed. 
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FIGURE 10.5 A/D quantization error distribution for the random signal in Esx- 
ample 10.2, B = 2 bits 
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FIGURE 10.6 Quantization error distribution for the random signal in Exam- 
ple 10.2, B=6 bits 
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Since practical signals processed using a DSP chip are typically ran- 
dom in nature (or can be modeled as such), we conclude from these two 
examples that the statistical model, with its stated assumptions, is a very 
good model. 


10.1.3 STATISTICS OF A/D QUANTIZATION NOISE 
We now develop a second-order statistical description of the error sequence 
e(n) for both the truncation and rounding operations. 


10.1.4 TRUNCATION 
From (6.57), the pdf fz,(e) of er(n) is uniform over [—A, 0], as shown in 
Figure 10.7a. Then the average of er(n) is given by 


Mer = Eler(n)] = —A/2 (10.4) 


and the variance is 


o2, E [(er(n) — mer)’] = / j (e — A/2)* fer (e) de 


Bie 1 A2 
= e? — de = — 10.5 
ice (x) 12 ane 


Using A = 2-®, we obtain 
9-2B 9-8 


as er = —- 10.6 
o or o a3 (10.6) 


Rounding From (6.59), the pdf fz,(e) of er(n) is uniform over 
[-A/2, A/2], as shown in Figure 10.7b. Then the average of er(n) is 


given by 
men = [Eer] = 0 (10.7) 
f(e) fR(e) 
1/A 
1/A 
e e 
-=A —A/2 0 -A/2 0 A/2 
(a) (b) 


FIGURE 10.7 Probability density functions: (a) truncation and (b) rounding 
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and the variance is 


A/2 A/2 1 
Tor - E [(er(n) ot Men) | = / e fEr (e) de = / e2 (<) de 
-4/2 —A/2 
A2 
~ 12 10. 
12 (10.8) 
Using (6.45), we obtain 
9-2B 9-B 
2 
=~ apr er =Z ZF 10. 
Teg 12 or (oy R 3 ( 0 9) 


Since the samples of the sequence eg(n) are assumed to be independent 
of each other, the variance of [en(n) + er(n — 1)]/2 is given by 


ern(n)+er(n—1)] _ 1 (2-7 in ea sae 1 2 
2 ~4\ 12 122) 4 #2 
(10.10) 


or the standard deviation is Cep /V2. 
From the model assumptions and (10.6) or (10.9), the covariance of 
the error sequence (which is an independent sequence) is given by 


9-2B 


2 ¢.(m—n) 2C.(0 = 5 


Ele(m)e(n)] 


6 (0) (10.11) 


A : ; ; 
where £ = m — n is called the lag variable. Such an error sequence is also 
known as a white noise sequence. 


10.1.5 MATLAB IMPLEMENTATION 

In MATLAB, the sample mean and standard deviation are computed 
using the functions mean and std, respectively. The last argument of the 
function StatModelR is a vector containing sample means and standard 
deviations of unnormalized errors e(n) and [e(n) + e(n — 1)]|/2. Thus, 
these values can be compared with the theoretical values obtained from 
the statistical model. 


EXAMPLE 10.3 The plots in Example 10.1 also indicate the sample means and standard devi- 
ations of the errors e(n) and [e(n) + e(n — 1)]/2. For B = 2, these computed 
values are shown in Figure 10.3. Since e(n) is uniformly distributed over the 
interval [—2~°, 27°], its mean value is 0, and so is the mean of [e(n)+e(n—1)]/2. 
The computed values are 3.4239 x 107% and 3.4396 x 10~°, respectively, which 
agree fairly well with the model. The standard deviation of e(n), from (10.9), is 
0.072169, while that from the top plot in Figure 10.3 is 0.072073, which again 
agrees closely with the model. The standard deviation of the average of the two 
consecutive samples, from (10.10), is 0.051031, and from the bottom plot in 
Figure 10.3 it is 0.063851, which clearly does not agree with the model. Hence 
the samples of e(n) for B = 2 are not independent. This was confirmed by the 
bottom plot in Figure 10.3. 
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Similarly, for B = 6 computed statistical values are shown in Figure 10.4. 
The computed values of the two means are —4.1044 x 107°, which agree very 
well with the model. The standard deviation of e(n), from (10.9), is 0.0045105, 
while that from the top plot in Figure 10.4 is 0.0045076, which again agrees 
closely with the model. The standard deviation of the average of the two con- 
secutive samples, from (10.10), is 0.0031894, while from the bottom plot in 
Figure 10.4 it is 0.00318181, which clearly agrees with the model. Hence the 
samples of e(n) for B = 6 are independent. This was also confirmed by the 
bottom plot in Figure 10.4. 


Similar calculations can be carried out for the signal in Example 10.2. 
The details are left to the reader. 


10.1.6 A/D QUANTIZATION NOISE THROUGH DIGITAL FILTERS 
Let a digital filter be described by the impulse response, h(n), or the fre- 
quency response, H(e™). When a quantized input, Q[a(n)] = x(n)+e(n), 
is applied to this system, we can determine the effects of the error sequence 
e(n) on the filter output as it propagates through the filter, assuming 
infinite-precision arithmetic implementation in the filter. We are generally 
interested in the mean and variance of this output-noise sequence, which 
we can obtain using linear system theory concepts. Details of these re- 
sults can be found in many introductory texts on random processes, 
including [27]. 

Referring to Figure 10.8, let the output of the filter be y(n). Using 
LTI properties and the statistical independence between x(n) and e(n), 
the output g(n) can be expressed as the sum of two components. Let y(n) 
be the (true) output due to x(n) and q(n) the response due to e(n). Then 
we can show that q(n) is also a random sequence with mean 


mg = Elq(n)] = me X` h(n) = me HC”) (10.12) 


where the term H(e?°) is termed the DC gain of the filter. For truncation, 
Mey = —A/2, which gives 


A 
Mex = —5 Ae") (10.13) 
For rounding, me, = 0 or 

Man = 0 (10.14) 


X(N) = x(n) + e(n) ——>} h(n), H(e!@) —> yin) = y(n) + a(n) 


FIGURE 10.8 Noise through digital filter 
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We can also show that the variance of q(n), for both the truncation or 
rounding, is given by 


T 


oo 2 
J aoa 2_ Te w) |2 
o4 = o4 2. |h(n)| = se f |H (e) dw (10.15) 


F 


The variance gain from the input to the output (also known as the nor- 
malized output variance) is the ratio 


o2 co 1 T 
a =X hhn) = zl |H(e”)|? dw (10.16) 


For a real and stable filter, using the substitution z = e™, the integral in 
(10.16) can be further expressed as a complex contour integral 


H 1 

/ |H(e%)|? dw = — $ H(z)H(z71)z-1dz (10.17) 
De 2779 Juc 

where UC is the unit circle and can be computed using residues (or the 

inverse Z-transform) as 


J |H(e™)|? dw = 5 [Residues of H(z)H(2~!)z71 inside UC](10.18a) 


= Z~! [H(2)H(27+)]| (10.18b) 


n=0 


10.1.7 MATLAB IMPLEMENTATION 
Computation of the variance-gain for the A/D quantization noise can be 
carried out in MATLAB using (10.16) and (10.18). For FIR filters, we can 
perform exact calculations using the time-domain expression in (10.16). 
In the case of IIR filters, exact calculations can only be done using (10.18) 
in special cases, as we shall see (fortunately, this works for most practical 
filters). The approximate computations can always be done using the 
time-domain expression. 

Let the FIR filter be given by the coefficients {b,}4/~'. Then using 
the time-domain expression in (10.16), the variance-gain is given by 


o2 M-1 
= =X ol (10.19) 
£ k=0 


Let an IIR filter be given by the system function 


N-1 _) 
bez 
H(z) = #0 
1+ dopa an27* 
with impulse response h(n). If we assume that the filter is real, causal, and 
stable and has only simple poles, then using the partial fraction expansion, 
we can write 


(10.20) 


N-1 


R 
H(z)=Rot+ So 
k=1 


Z — Pk 


(10.21) 
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where Ro is the constant term and R,’s are the residues at the pole 
locations py. This expansion can be computed using the residue function. 
Note that both poles and the corresponding residues are either real-valued 
or occur in complex-conjugate pairs. Then using (10.18a), we can show 
that (see [17] and also Problem P10.3) 


o2 N—1 N-11 R, R* 
4_ p2 y y g 
e k=1 0=1 £ 


The variance-gain expression in (10.22) is applicable for most practical 
filters since rarely do they have multiple poles. The approximate value of 
the variance-gain for IIR filters is given by 


2 K-1 
e ~E an)’?, K>1 (10.23) 
g k=0 


where K is chosen so that the impulse response values (magnitudewise) 
are almost zero beyond K samples. The following MATLAB function, 
VarGain, computes variance-gain using (10.19) or (10.22). 


function Gv = VarGain(b,a) 
% Computation of variance-gain for the output noise process 
% of digital filter described by b(z)/a(z) 
% Gv = VarGain(b,a) 
a0 = a(1); a = a/a0; b = b/a0; M = length(b); N = length(a); 
if N == % FIR Filter 
Gv = sum(b.*b) ; 
return 
else % IIR Filter 
[R,p,P] = residue(b,a); 
if length(P) > 1 
error(’?*** Variance Gain Not computable ***’) ; 
elseif length(P) == 1 
Gv = PxP; 
else 
Gv = 0; 
end 
Rnum = R*R’; pden = 1-p*p’; 
H = Rnum./pden; Gv = Gv + real(sum(H(:))); 
end 


It should be noted that the actual output noise variance is obtained by 
multiplying the A/D quantization noise variance by the variance-gain. 


EXAMPLE 10.4 Consider an 8-order IIR filter with poles at py = re??7*/®, k =0,...,7. If r is 
close to 1, then the filter has 4 narrowband peaks. Determine the variance-gain 
for this filter when r = 0.9 and r = 0.99. 
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Solution The following MATLAB script illustrates calculations for r = 0.9, which imple- 
ments exact as well as approximate approaches. 


% Filter Parameters 
N = 8; r = 0.9; b = 1; pl = r*exp(j*2*pi*[0:N-1]/N); a = real(poly(pl)); 


% Variance-gain (Exact) 
Vg = VarGain(b,a) 
Vg = 
1.02896272593178 
% Variance-Gain (approximate) 
x = [1,zeros(1,10000)]; % Unit sample sequence 


h = filter(b,a,x); % Impulse response 
VgCheck = sum(h. *h) 
VgCheck = 


1.02896272593178 


Clearly, both approaches give the same variance-gain, which for r = 0.9 is about 
3% above unity. For r = 0.99 the calculations are: 


% Filter Parameters 
N = 8; r = 0.99; b = 1; pl = r*exp(j*2*pi*[0:N-1]/N); a = real(poly(pl)); 
% Variance-gain (Exact) 
Vg = VarGain(b,a) 
Vg = 
6. 73209233071894 


The variance-gain is more than 673%, which means that when poles are close 
to the unit circle, the filter output can be very noisy. 


10.2 ROUND-OFF EFFECTS IN IIR DIGITAL FILTERS 
—— g 


With our insight into the quantizer operation and its simpler statistical 
model, we are now ready to delve into the analysis of finite word-length 
effects in both IIR and FIR digital filters. We have already studied the 
effects of input signal quantization and filter coefficient quantization on 
filter behavior. We will now turn our attention to the effects of arithmetic 
operation quantization on filter output responses (in terms of signal-to- 
noise ratios). For this study we will consider both fixed-point and floating- 
point arithmetic. We first consider the effects on IIR filters since, due to 
feedback paths, the results are more complicated—yet more interesting— 
than those in FIR filters. The effects on FIR filters are studied in the next 
section. 
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We will restrict ourselves to the rounding operation of the quan- 
tizer due to its superior statistical qualities (no bias or average value). 
From (6.59), we know that, for the rounding operation, the quantizer 
error, er, has the same characteristics across all three number representa- 
tion formats. Hence for MATLAB simulation purposes, we will consider 
the sign-magnitude format because it is easy to program and simulate 
for arithmetic operation. However, in practice, two’s-complement format 
number representation has advantages over the others in terms of hard- 
ware implementation. 

Digital filter implementation requires arithmetic operations of mul- 
tiplication and addition. If two B-bit fractional numbers are multiplied, 
the result is a 2B-bit fractional number that must be quantized to B bits. 
Similarly, if two B-bit fractional numbers are added, the sum could be 
more than one, which results in an overflow, which in itself is a nonlinear 
characteristic; or the sum must be corrected using a saturation strategy, 
which is also nonlinear. Thus, a finite word-length implementation of the 
filter is a highly nonlinear filter and must be analyzed carefully for any 
meaningful results. 

In this section, we will consider two approaches to deal with errors due 
to finite word-length representation. The first type of error can occur when 
error samples become correlated with each other due to the nonlinearity 
of the quantizer. This is called limit-cycle behavior, and it can exist only 
in IIR filters. We will analyze this problem using the nonlinear quantizer 
model rather than the statistical model of the quantizer. In the second 
type of error, we assume that more nonlinear effects in the quantizer have 
been suppressed. Then, using the statistical model of the quantizer, we 
develop a quantization noise model for IIR filters that is more useful in 
predicting the finite word-length effects. 


10.2.1 LIMIT CYCLES 

Digital filters are linear systems, but when quantizers are incorporated 
in their implementation, they become nonlinear systems. For nonlinear 
systems it is possible to have an output sequence even when there is no 
input. Limit cycles is one such behavior that creates an oscillatory periodic 
output that is highly undesirable. 


m DEFINITION 1 Limit cycle 

A zero-input limit cycle is a nonzero periodic output sequence pro- 
duced by nonlinear elements or quantizers in the feedback loop of a 
digital filter. 
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There are two types of limit cycles. The granular limit cycles are due 
to nonlinearities in multiplication quantization and are of low amplitude. 
The overflow limit cycles are a result of overflow in addition and can have 
large amplitudes. 


10.2.2 GRANULAR LIMIT CYCLES 

This type of limit cycle can easily be demonstrated with a simple round- 
ing quantizer following a multiplication. We illustrate with the following 
example. 


EXAMPLE 10.5 Consider a simple Ist-order IIR filter given by 


y(n) =ay(n—1)+2(n); y(-1)=0, n>0 (10.24) 


Let a = —$; then this is a highpass filter, since its pole is near z = —1. 
Determine the output y(n) when x(n) = 26(n), assuming a 3-bit quantizer in 


~ 8 
the multiplier. 


Solution After multiplication by a, we have to quantize the result. Let the output due 
to this quantization be §(n). Then the actual implementable digital filter is 


an) = 2[-S9n-D] +0); G-1)=0, nzo (10.25) 


We assume that the input in (10.24) is quantized and that there is no overflow 
due to addition. Let B = 3 (that is, we have 3 fraction bits and 1 sign bit) and 
let x(n) = £6(n). Now a = —5 is represented by 14110 in two’s-complement 
format. Hence the output sequence is obtained as: 


: 04111 


: 14100 


: 04010 


(10.26) 


: 04001 


= : 14111 


) 
) 
ee ee 
) 
) 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Round-off Effects in IIR Digital Filters 553 


Thus §(n) = +3 for n > 5. The desired output y(n) is 


7 7 7 hk 
Hence the error sequence is 
x á 1 1 1 9 opel 
e(n) = on) — y(n) = {0-a a a o t} (10.28) 


This shows that the error e(n) slowly builds up to +5. Hence the error is 
asymptotically periodic with period 2. 


From Example 10.5, it is clear that, in the steady state, the system 
has poles on the unit circle and hence the nonlinear system has effectively 
become a linear system [12]. This implies that, effectively, for the system 
in (10.24) 


gln- 1)] = { Bes Tye a> Os (10.29) 


—ĝ(n— 1), a <0. 


Also due to the rounding operation, the quantization error is bounded by 
+A/2 where A = 2~® is the quantization step, or 


A 
|Qlag(n— DJ —ag(n- Yi < 5 (10.30) 
From (10.29) and (10.30), we conclude that 
A 
(n — 1)| < 10.31 
lĝ(n -= 1)| < aja) (10.31) 


which is the amplitude range of limit-cycle oscillations and is called a dead 
band. For the system in Example 10.5, B = 3 and a = —ż4. Hence the 
dead-band range is +3, which agrees with (10.31). If the output ĝ(n — 1) 
gets trapped in this band when the input is zero, the filter exhibits the 
granular limit cycle. From (10.29), the period of the oscillation is either 


1 or 2. 


Analysis using MATLAB In our previous MATLAB simulations, we 
did not worry about the quantization in multiplication or addition op- 
erations because the emphasis was on either signal quantization or on 
filter coefficient quantization. The important operation that we have to 
consider is the arithmetic overflow characteristics. We assume that the 
represented numbers are in fractional two’s-complement format. Then in 
practice, two overflow characteristics are used: a two’s-complement over- 
flow, which is a modulo (periodic) function, and a saturation, which is a 
limiting function. These characteristics are shown in Figure 10.9. 
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(a) Two’s-complement Overflow (b) Saturation 


FIGURE 10.9 Overflow characteristics used in Qfix 


To simulate these two effects, we provide the function y = Qfix(x,B, 
?Qmode’,’Omode’). This function performs a fixed-point two’s- 
complement format quantization using (B+1)-bit representation so that 
the resulting number y is between —1 < y < 1. The quantization mode, 
Qmode, is either a rounding or a truncation operation. The overflow char- 
acteristic is provided in Omode. Using this function, we can study both 
types of limit cycles. 


function [y] = QFix(x,B,Qmode, Omode) 
% Fixed-point Arithmetic using (B+1)-bit Representation 


Yh EE EE EEE EEE E E E 
% [y] = QFix(x,B,Qmode,Omode) 

h y: Decimal equivalent of quantized x with values in [-1,1) 
h x: a real number array 

h B: Number of fractional bits 

% Qmode: Quantizer mode 

h *round’: two’s-complement rounding characteristics 

hh *trunc’: Two’s complement truncation characteristics 

% Omode: Overflow mode 

h ?satur’: Saturation limiter 

h *twosc’: Two’s-complement overflow 


% Quantization operation 
if strcmp(lower(Qmode), ’round’) ; 
y = round(x.*(27B)); 
elseif strcmp(lower(Qmode), ’trunc’); 
y = floor(x.*(2°B)); 
else 
error(’Use Qmode = "round" or "trunc"’); 
end; 
y = y*(2°(-B)); % (B+1)-bit representation 
% Overflow operation 
if strcmp(lower(Omode), ’satur’); 
y = min(y,1-27(-B)); y = max(-1,y); % Saturation 
elseif strcmp(lower(Omode), ’twosc’); 
y = 2*(mod(y/2-0.5,1)-0.5); % Overflow 
else error(’Use Omode = "satur" or "twosc"’); 
end; 
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EXAMPLE 10.6 In this example simulate the results for the system given in Example 10.5 using 
the Qfix function with B = 3 bits. In addition, also examine limit-cycle behavior 
for the truncation operation in the multiplier and for the case when the system 
is a lowpass filter with coefficient a = 0.5. 


Solution The MATLAB scripts: 


% Highpass filter, rounding operation in multiplier 
a = -0.5; yni = 0; m = 0:10; y = [yn1, zeros(1,length(m))]; 
0.875*impseq(m(1) ,m(1)-1,m(end)) ; 
for n = m+2 
yni = y(n-1); 
y(n) = QFix(a*yn1,3,’round’,’satur’) + x(n); 
end 


tal 
i] 


subplot (’ position’, [0.08,0.2,0.24,0.6]); 
plot([-1,20],[0,0],’w’); axis([-1,10,-1,1]); hold on; 
Hs_1 = stem([-1,m],y,’filled’);set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’ , ’fontsize’ ,8) ; 
title(’\alpha = -0.5, Rounding’, ’fontsize’ ,10); 
xlabel(’Sample index n’,’fontsize’ ,8); 
% Lowpass filter, rounding operation in multiplier 
a = 0.5; yn1 = 0; m = 0:10; y = [yn1, zeros(1,length(m))]; 
0.875*impseq(m(1) ,m(1)-1,m(end)) ; 
for n = m+2 
yni = y(n-1); 
y(n) = QFix(a*yn1,3,’round’,’satur’) + x(n); 
end 


tad 
Il 


subplot (’position’ ,[0.42,0.2,0.24,0.6]); 

plot([-1,20],[0,0],’w’); axis([-1,10,-1,1]); hold on; 

Hs_1 = stem([-1,m],y,’filled’);set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’, ’fontsize’ ,8) ; 
title(’\alpha = 0.5, Rounding’, ’fontsize’ ,10); 

xlabel(’Sample index n’,’fontsize’ ,8); 


% Highpass filter, Truncation operation in multiplier 
a = -0.5; yni = 0; m = 0:10; y = [yn1, zeros(1,length(m))]; 
x = 0.875*impseq(m(1) ,m(1)-1,m(end)) ; 
for n = m+2 
yni = y(n-1); 
y(n) = QFix(a*yn1,3,’trunc’,’satur’) + x(n); 
end 


subplot (’ position’, [0.76,0.2,0.24,0.6]); 
plot([-1,20],[0,0],’w’); axis([-1,10,-1,1]); hold on; 
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FIGURE 10.10 Granular limit cycles in Example 10.6 


Hs_1 = stem([-1,m],y,’filled’);set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’, ’fontsize’ ,8) ; 
title(’\alpha = -0.5, Truncation’, ’fontsize’ ,10); 

xlabel(’Sample index n’,’fontsize’ ,8); 


The resulting plots are shown in Figure 10.10. The output signal in the left 
plot agrees with that in Example 10.5 and has an asymptotic period of two 
samples. The middle plot for a = 0.5 (lowpass filter) shows that the limit cycle 
has a period of one sample with amplitude of 4. Finally, the right plot shows 
that the limit cycles vanish for the truncation operation. This behavior for the 
truncation operation is also exhibited for lowpass filters. 


In the case of 2nd-order and higher-order digital filters, granular limit 
cycles not only exist but also are of various types. These cycles in 2nd- 
order filters can be analyzed, and dead-band as well as frequency of os- 
cillations can be estimated. For example, if the recursive all-pole filter is 
implemented with rounding quantizers in the multipliers as 


y(n) = Qlarg(n — 1)] + Qlagg(n — 2)] + a(n) (10.32) 


where ĝ(n) is the quantized output, then using the analysis similar to that 
of the 1-order case, the dead-band region is given by 


G(n—2)< A 


E (10.33) 


with a, determining the frequency of oscillations. For more details see 
Proakis, and Manolakis [23]. We provide the following example to illus- 
trate granular limit cycles in 2nd-order filters using 3-bit quantizers. 


EXAMPLE 10.7 Consider the 2nd-order recursive filter 


y(n) = 0.875y(n — 1) — 0.75y(n — 2) + x(n) (10.34) 
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with zero initial conditions. This filter has two complex-conjugate poles and 
hence is a bandpass filter. Let the input be x(n) = 0.3756(n). Analyze the limit 
cycle behavior using a 3-bit quantizer. 


Solution In the filter implementation the coefficient products are quantized, which 
results in 


ĝln) = Q[0.875g(n — 1)] — Q[0.759(n — 2)] + x(n) (10.35) 


where j(n) is the quantized output. We simulate (10.35) in MATLAB using 
both the rounding and truncation operations. 


% Bandpass filter 
al = 0.875; a2 = -0.75; 


% Rounding operation in multipliers 


wal = Of sal = Os 

m = 0:20; y = [yn2,yn1,zeros(1,length(m))]; 
x = 0.375*impseq(m(1) ,m(1)-2,m(end)) ; 

for n = m+3 


yni = y(n-1); yn2 = y(n-2); 
y(n) = QFix(al*yn1,3,’round’,’satur’)+QFix(a2*yn2,3,’round’,’satur’)+x(n) ; 
end 


subplot (’position’,[0.1,0.2,0.39,0.6]); 

plot([-1,20],[0,0],’w’); axis([-1,20,-0.5,0.5]); hold on; 

Hs_1 = stem([-2,-1,m],y,’filled’); set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 

set (gca,’ytick’,[-0.5:0.25:0.5],’fontsize’,6); ylabel(’ Amplitude’ , ’fontsize’ ,8) ; 
title(’Rounding Operation’, ’fontsize’ ,10); 

xlabel(’Sample index n’,’fontsize’ ,8); 


% Truncation operation in multipliers 
youl = Og sme = Os 
m = 0:20; y = [yn2,yn1,zeros(1,length(m))]; 
x = 0.375*impseq(m(1) ,m(1)-2,m(end)) ; 
for n = m+3 
yni = y(n-1); yn2 = y@-2); 
y(n) = QFix(al*yn1,3,’trunc’,’satur’)+QFix(a2*yn2,3,’trunc’,’satur’)+x(n) ; 
end 


subplot (’position’, [0.59,0.2,0.39,0.6]); 

plot([-1,20],[0,0],’w’); axis([-1,20,-0.5,0.5]); hold on; 

Hs_1 = stem([-2,-1,m],y,’filled’); set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 

set (gca,’?ytick’,[-0.5:0.25:0.5],’fontsize’ ,6); ylabel(’ Amplitude’ , ’fontsize’ ,8) ; 
title(’Truncation Operation’, ’fontsize’ ,10); 

xlabel(’Sample index n’,’fontsize’ ,8); 
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FIGURE 10.11 Granular limit cycles in Example 10.7 


The resulting plots are shown in Figure 10.11. The round-off limit cycles have a 
period of six samples and amplitude of 0.25, which agrees with (10.33). Unlike 
in the case of 1st-order filters, the limit cycles for the 2nd-order exist even when 
truncation is used in the quantizer. 


10.2.3 OVERFLOW LIMIT CYCLES 

This type of limit cycle is also a zero-input behavior that gives an os- 
cillatory output. It is due to overflow in the addition even if we ignore 
multiplication or product quantization in the filter implementation. This 
is a more serious limit cycle because the oscillations can cover the entire 
dynamic range of the quantizer. It can be avoided in practice by using 
the saturation characteristics instead of overflow in the quantizer. In the 
following example, we simulate both granular and overflow limit cycles in 
a second-order filter, in addition to infinite precision implementation. 


EXAMPLE 10.8 To obtain overflow in addition we will consider the second-order filter with large 
coefficient values and initial conditions (magnitudewise) excited by a zero input: 


y(n) = 0.875y(n — 1) — 0.875y(n— 1); y(—1) = —0.875, y(—2) = 0.875 
(10.36) 
The overflow in the addition is obtained by placing the quantizer after the 
additions as 


O(n) = Q[0.8759(n — 1) — 0.8759(n —1)]; | G(—1) = —0.875, g(—2) = 0.875 
(10.37) 
where §(n) is the quantized output. We first simulate the infinite-precision op- 


eration of (10.36) and compare its output with the granular limit-cycle imple- 
mentation in (10.35) and with the overflow limit-cycle in (10.37). We use the 
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rounding operation. The details are in the MATLAB script: 


M = 100; B = 3; A = 1-27(-B); 
aul SING e2 = SMe sani = oie yanZi = Ms 
m = 0:M; y [yn2,yn1,zeros(1,length(m))]; 


% Infinite precision 
for n = m+3 
yni = y(n-1); yn2 = y(n-2); 
y(n) = al*yn1 + a2*yn2; 
end 
subplot (’position’ ,[0.08,0.2,0.24,0.6]); 
plot([-1,100],[0,0],’w’); axis([-1,80,-1,1]); hold on; 
Hs_1 = stem([-2,-1,m],y,’filled’) ;set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’, ’fontsize’ ,8) ; 
title(’No Limit Cycles’ ,’fontsize’ ,10) ; 
xlabel(’Sample index n’,’fontsize’ ,8) ; 


% Granular limit cycle 
for n = m+3 
yni = y(n-1); yn2 = y(n-2); 
y(n) = QFix(al*yn1,B,’round’,’satur’)+QFix(a2*yn2,B,’round’,’satur’) ; 
y(n) = QFix(y(n),B,’ round’ ,’ satur’); 
end 
subplot (’position’ ,[0.42,0.2,0.24,0.6]); 
plot([-1,100],[0,0],’w’); axis([-1,80,-1,1]); hold on; 
Hs_1 = stem([-2,-1,m],y,’filled’) ;set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’ , ’fontsize’ ,8) ; 
title(’Granular Limit Cycles’ ,’fontsize’ ,10); 
xlabel(’Sample index n’,’fontsize’ ,8); 


% Overflow limit cycle 
for n = m+3 
yni = y(n-1); yn2 = y(n-2); 
y(n) = al*yni + a2*yn2; 
y(n) = QFix(y(m),B,’round’,’twosc’); 
end 
subplot (’ position’, [0.76,0.2,0.23,0.6]); 
plot([-1,100],[0,0],’w’); axis([-1,80,-1,1]); hold on; 
Hs_1 = stem([-2,-1,m],y,’filled’) ;set(Hs_1,’markersize’ ,3,’color’,[0,1,0]); 
set(gca,’ytick’,[-1:0.25:1],’fontsize’,6); ylabel(’ Amplitude’, ’fontsize’ ,8) ; 
title(’Overflow Limit Cycles’ ,’fontsize’ ,10); 
xlabel(’Sample index n’,’fontsize’ ,8); 


The resulting plots are shown in Figure 10.12. As expected, the infinite-precision 
implementation has no limit cycles. The granular limit cycles are of smaller 
amplitudes. Clearly, the overflow limit cycles have large amplitudes spanning 
the —1 to 1 range of the quantizers. 
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FIGURE 10.12 Comparison of limit cycles in Example 10.8 


As shown in these examples, the limit-cycle behaviors of many differ- 
ent filters can be studied for different quantizer characteristics using the 
MATLAB function QFix. 


10.2.4 MULTIPLICATION QUANTIZATION ERROR 
A multiplier element in the filter implementation can introduce additional 
quantization errors since multiplication of two B-bit fractional numbers 
results in a 2B-bit fraction and must be quantized to a B-bit fraction. 
Consider a multiplier in fixed-point arithmetic with B = 8. The number 
Z is represented as 0.578125 in decimal. The square of 0.578125 rounded 
to 8 bits is 0.3359375 (which should not be confused with 1/3 rounded to 
8 bits, which is 0.33203125). The additional error in the squaring opera- 
tion is 

0.3359375 — (0.578125)? = 0.001708984375 
This additional error is termed as the multiplication quantization error. Its 
statistically equivalent model is similar to that of the A/D quantization 
error model, as shown in Figure 10.13. 


Statistical model Consider the B-bit quantizer block following the 
multiplier element shown in Figure 10.13a. The sequence x(n) and the con- 
stant c are quantized to B fractional bits prior to multiplication (as would 
be the case in a typical implementation). The multiplied sequence {ca(n)} 
is quantized to obtain y(n). We want to replace the quantizer by a simpler 
linear system model shown in Figure 10.13b, in which y(n) = ca(n)+e(n), 


x(n) | a ;- Q[cx(n)] = x(n) : cx(n) + e(n) 


e(n) 
(a) Quantizer (b) Linear system model 


FIGURE 10.13 Linear system model for multiplication quantization error 
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where e(n) is a multiplication quantization error. For analysis purposes 
we assume that the conditions on e(n) are similar to those for the A/D 
quantization error: 


1. The random signal e(n) is uncorrelated with the sequence x(n) for 
rounding operation (or two’s-complement truncation operation) in the 
quantizer. 

2. The signal e(n) is an independent process (i.e., the samples are inde- 
pendent of each other). 

3. The probability density function (pdf) fg(e) of e(n) for each n is uni- 
formly distributed over the interval of width A = 278, which is the 
quantizer resolution. 


We will emphasize the rounding operation for the rest of this section. 
Based on the above model assumptions, the results given in (10.7), (10.9), 
and (10.10) are also applicable for the multiplication quantization error 
e(n). 

We offer the following two MATLAB examples to illustrate this 
model. A more thorough investigation of this error can be found in 
Rabiner and Tukey [25]. 


EXAMPLE 10.9 Consider the sequence given in Example 10.1, which is repeated here. 


x(n) = ; [sin(n/11) + sin(n/31) + cos(n/67)| 


This signal is multiplied by c = 1/V2, quantized to B bits and the resulting 
multiplication is quantized to B bits with rounding. Using the StatModelR 
function and 500,000 samples, compute and analyze normalized errors e1(n) 
and e€2(n), defined in (10.2) and (10.3), respectively. 


Solution The following MATLAB script computes error distribution, for B = 6 bits. 


clear; close all; 

%⁄ Example parameters 

B = 6; N = 500000; n = [1:N]; bM = 7; 

xn = (1/3)*(sin(n/11)+sin(n/31)+cos(n/67)); clear n; 

c = 1/sqrt (2); 

% Signal and Coefficient Quantization 

xq = (round(xn*(27*B)))/(27B); c = (round(c*(27B)))/(27B) ; 

cxq = c*xq; % Multiplication of constant and signal 
% Quantization error analysis 

[H1,H2,Q, estat] = StatModelR(cxq,B,N); 

Himax = max(Hi); Himin = min(H1); yj, Max and Min of H1 
H2max = max(H2); H2min = min(H2); ù% Max and Min of H2 
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FIGURE 10.14 Multiplication quantization error distribution for the sinusoidal 
signal in Example 10.9, B = 6 bits 


The plots of the resulting histogram are shown in Figure 10.14. For the sinu- 
soidal signal, when B = 6 bits, the error samples are not uniformly distributed 
and the samples are not independent. The means of e(n) and [e(n) +e(n —1)]/2 
are small. Their standard deviations are 0.0045105 and 0.0031059, which do 
not agree with (10.10). The corresponding plots for B = 12 bits are shown in 
Figure 10.15 from which we observe that the quantization error sequence ap- 
pears to satisfy the model assumptions for B > 12 bits. The means of e(n) and 
[e(n) + e(n — 1)]/2 are very small, and their standard deviations agree closely 
with (10.10). 


EXAMPLE 10.10 Let x(n) be an independent and identically distributed random sequence whose 
samples are uniformly distributed over the [—1, 1] interval. Using 500,000 sam- 
ples to minimize any statistical variations, analyze normalized errors. 


Solution The following MATLAB script computes the distributions for B = 6 bits. 


clear; close all; 

% Example parameters 

B = 6; N = 500000; xn = (2*rand(1,N)-1); ÞM = 7; c = 1/sqrt(2); 

% Signal and Coefficient Quantization 

xq = (round(xn*(27*B)))/(27B); c = (round(c*(27*B)))/(27B) ; 

cxq = c*xq; % Multiplication of constant and signal 
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FIGURE 10.15 Multiplication quantization error distribution for the sinusoidal 
signal in Example 10.9, B = 12 bits 


% Quantization error analysis 

[H1,H2,Q, estat] = StatModelR(cxq,B,N); 

Himax = max(Hi); Himin = min(H1); % Max and Min of H1 
H2max = max(H2); H2min = min(H2); ù% Max and Min of H2 


The plots of the resulting histogram are shown in Figure 10.16. Even for B = 6 
bits, the error samples appear to be uniformly distributed (albeit in discrete 
fashion) and are independent of each other. The corresponding plots for B = 12 
bits are shown in Figure 10.17. It is clear for B = 12 bits that the quantization 
error samples are independent and uniformly distributed. Readers should verify 
the statistics of these errors given in (10.7), (10.9), and (10.10). 


From these two examples, we conclude that the statistical model for 
the multiplication quantization error, with its stated assumptions, is a 
very good model for random signals when the number of bits in the quan- 
tizer is large enough. 


10.2.5 STATISTICAL ROUND-OFF NOISE—FIXED-POINT ARITHMETIC 
In this and the next section, we will consider the round-off effects on IIR 
filters using the multiplication quantization error model developed in the 
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FIGURE 10.16 Multiplication quantization error distribution for the random 
signal in Example 10.10, B = 6 bits 
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FIGURE 10.17 Multiplication quantization error distribution for the random 
signal in Example 10.10, B = 12 bits 
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x(n) y(n) y(n) + q(n) 


(c) 


FIGURE 10.18 First-order IIR filter: (a) structure, (b) structure with quantizer, 
(c) round-off noise model 


previous section. Since we emphasize the rounding operation, this model 
is also known as a round-off noise model. We will limit ourselves to the 1st- 
and 2nd-order filters since practical realizations involve 1st- or 2nd-order 
sections. 


1st-order filter Consider the 1st-order filter shown in Figure 10.18a. 
When a quantizer Q[-] is introduced after the multiplier, the resulting 
filter model is shown in Figure 10.18b, which is a nonlinear system. When 
Q [-] is a quantizer based on the round-off characteristics, then its effect is 
to add a zero-mean, stationary white noise sequence e(n) at the multiplier 
output as shown in Figure 10.18c. 

Let q(n) be the response due to e(n) and let he(n) be the noise impulse 
response (i.e., between e(n) and q(n)). For the system in Figure 10.18c 


he(n) = h(n) = a”u(n) (10.38) 


Using (10.12) and (10.7), the mean of q(n) is 
Mg = Me X he(n) =0 (10.39) 
0 


Similarly, using (10.15), the variance of q(n) is 


o2 = o? (>: mw) (10.40) 
0 


Substituting o? = 27?B/12 for rounding and he(n) from (10.38), we 
obtain 


9-2B 


5 oo 5 9-2B oo aii 9-2B 
% = Sole")? | = 12 S (le?)" = la) (10.41) 
0 


0 


which is the output noise power due to rounding following the multipli- 
cation. 
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o y(n) + q(n) 


FIGURE 10.19 Scaled first-order IIR filter: (a) structure with quantizer, (b) 
round-off noise model 


However, we also have to prevent a possible overflow following the 
adder. Let y(n) be the signal at the output of the adder in Figure 10.18a, 
which in this case is equal to y(n). Now the upper bound on y(n) is 


= one 


Let the input sequence be bounded by Xmax (i-e., |e(n)| < Xmax). Then 


lvi(n)| = o< im )| |e(n—k)| (10.42) 


lvi (n)| < Xmax X |A(k)| (10.43) 


Since yı(n) is represented by B fraction bits, we have |yı(n)| < 1. The 
condition (10.43) can be satisfied by requiring 
1 1 
Xmax e = =1-|al (10.44) 
2o lkl) 1/1 — led) 
Thus, to prevent overflow x(n) must satisfy 
—(1— al) < a(n) < (1 — jal) (10.45) 


Thus, the input must be scaled before it is applied to the filter as shown 
in Figure 10.19. 


Signal-to-noise ratio We will now compute the finite word-length 
effect in terms of the output signal-to-noise ratio (SNR). We assume 
that there is no overflow at the output by properly scaling x(n). Let 
x(n) be a stationary white sequence, uniformly distributed between 
[— (1 — Jal) ,(1 — Ja). Then 


1— lal)? 
M,z=0 and o= =u (10.46) 
Therefore, y(n) is also a stationary random sequence with mean my = 0 
and 
o2 = o2 5 Ih(n)|? e (1 Ta la)? 1 + (1 = Jal)? (10 47) 
AR 3  1=ļa? 3(-ļaļ?) l 
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Using (10.41) and (10.47), the output SNR is 

02 (1-lea)? 12(1 lal?) 

o? a= lee) 2-72 (10.48) 
= 4 (28) (1 — al)? = 2°49 (1 — Jal)” 

or the SNR in dB is 


I> 


SNR 


SNRap £ 10log,o(SNR) = 6.02 + 6.02B + 20logy)(1—Ja|) (10.49) 


Let 6 = 1 — |a|, which is the distance of the pole from the unit circle. 
Then 
SNRap = 6.02 + 6.02B + 20 logo (ô) (10.50) 
which is a very informative result. First, it shows that the SNR is directly 
proportional to B and increases by about 6 dB for each additional bit 
added to the word length. Second, the SNR is also directly proportional 
to the distance 6. The smaller the 6 (or nearer the pole to the unit circle), 
the smaller is the SNR, which is a consequence of the filter characteristics. 
As an example, if B = 6 and 6 = 0.05, then SNR = 16.12 dB and if B = 12 
and 6 = 0.1, then SNR = 58.26 dB. 


10.2.6 ANALYSIS USING MATLAB 

To analyze the properties of the round-off errors in IIR filters we will 
simulate them using the MATLAB function QFix with quantization mode 
’ round’ and overflow mode ’satur’. If proper scaling to avoid overflow is 
performed, then only the multiplier output needs to be quantized at each 
n without worrying about the overflow. However, we will still saturate 
the final sum to avoid any unforeseen problems. In previous simulations, 
we could perform the quantization operations on vectors (i.e., perform 
parallel processing). Since IIR filters are recursive filters and since each 
error is fed back into the system, vector operation is generally not possible. 
Hence the filter output will be computed sequentially from the first to the 
last sample. For a large number of samples, this implementation will slow 
the execution speed in MATLAB since MATLAB is optimized for vector 
calculations. However, for newer fast processors, the execution time is 
within a few seconds. These simulation steps are detailed in the following 
example. 


EXAMPLE 10.11 Consider the model given in Figure 10.19b. We will simulate this model in 
MATLAB and investigate its output error characteristics. Let a = 0.9, which 
will be quantized to B bits. The input signal is uniformly distributed over 
the [—1,+1] interval and is also quantized to B bits prior to filtering. The 
scaling factor Xmax is computed from (10.44). Using 100,000 signal samples 
and B = 6 bits, the following MATLAB script computes the true output y(n), 
the quantized output ĝ(n), the output error q(n), and the output SNR. 
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close all; clc; 


%⁄ Example Parameters 


B= 6; % # of fractional bits 

N = 100000; % # of samples 

xn = (2*rand(1,N)-1); % Input sequence - Uniform Distribution 
a = 0.9; % Filter parameter 

Xm = 1-abs(a) ; % Scaling factor 


¥, Local variables 


bM = 7; DbM = 27bM; % bin parameter 
BB = 2°B; % useful factor in quantization 
M = round(DbM/2) ; % Half number of bins 
bins = [-M+0.5:1:M-0.5]; % Bin values from -M to M 
Q = bins/DbM; %, Normalized bins 
YTN = 27(-bM); 7%, Ytick marks interval 
YLM = 4*YTN; % Yaxis limit 


% Quantize the input and the filter coefficients 
xn = QFix(Xm*xn,B,’round’,’satur’); % Scaled Input quant to B bits 
a = QFix(a,B,’ round’ ,’ satur’); % a quantized to B bits 


% Filter output without multiplication quantization 
yn = filter(1,[1,-a],xn); % output using filter routine 


% Filter output with multiplication quantization 


yq = zeros(1,N); % Initialize quantized output array 
yq(1) = xn(1); % Calculation of the first sample yq(1) 
foe JL Ss 


A1Y = QFix(a*yq(I-1),B,’round’,’satur’); % Quantization of a*y(n-1) 
yq(I) QFix(A1Y+xn(I),B,’round’,’satur’); % I-th sample yq(I) 
end 


% Output Error Analysis 


en = yn-yq; % Output error sequence 
varyn = var(yn); varen = var(en); % Signal and noise power 
eemax = max(en); eemin = min(en); ù% Maximum and minimum of the error 
enmax = max(abs([eemax,eemin] )) ; % Absolute maximum range of the error 
enavg = mean(en); enstd = std(en); ù% Mean and std dev of the error 
en = round(en*(2~bM)/(2*enmax)+0.5); % Normalized en (integer between -M & M) 
en = sort([en,-M:1: (M+1)]); 4, 
H = diff (find(diff(en)))-1; % Error histogram 
H = H/N; % Normalized histogram 
Hmax = max(H); Hmin = min(H); % Max and Min of the normalized histogram 


% Output SNRs 
SNR_C = 10*logi0(varyn/varen); % Computed SNR 
SNR_T = 6.02 + 6.02*B + 20*log10(Xm); % Theoretical SNR 
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0.0313 


SAMPLE SIZE N = 100000 ROUNDED TO B 6 BITS 
PARAMETER a = 0.90625 ERROR MEAN = -3.2612e-005 
SNR (THEORY) 22.14 SNR (COMPUTED) 22.2105 


0.0234 


0.0156 


Distribution of Output Error 
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FIGURE 10.20 Multiplication quantization effects in the first-order IIR filter in 
Example 10.11, B = 6 bits 


The part of the script not shown above also computes and plots the normal- 
ized histogram of the output error and prints the statistical values in the plot, 
as shown in Figure 10.20. The error appears to have a Gaussian distribution, 
which is to be expected. The exact value of the output SNR is 22.14 dB, which 
agrees with the computed value of 22.21 dB. Similar results done for B = 12 
bits are shown in Figure 10.21. Again, the simulation results agree with the 
model results. 


2nd-order filter Similar analysis can be done for 2nd-order filters with 
poles near the unit circle. Let the two poles be at complex locations re’? 
and re-/°, Then the system function of the filter is given by 


1 1 
A(z) = = 
(2) (1 — rei®z-1)(1 — rez!) 1 — 2rcos(6) 2-1 + r2z-? 
(10.51) 
with impulse response 
_ r™sin{(n + 1)0} 


The difference equation from (10.51) is given by 
y(n) = x(n)—a ,y(n—1)—agy(n—2); aı = —2rcos(@), az = r? (10.53) 


which requires two multiplications and two additions, as shown in 
Figure 10.22a. Thus, there are two noise sources and two possible lo- 
cations for overflow. The round-off noise model for quantization following 
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0.0313 
SAMPLE SIZE N = 100000 ROUNDED TO B 12 BITS 
PARAMETER a = 0.8999 ERROR MEAN = -1.282e-007 
SNR (THEORY) 58.26 SNR (COMPUTED) 58.134 
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FIGURE 10.21 Multiplication quantization effects in the 1st-order IIR filter in 
Example 10.11, B = 12 bits 


the two multipliers is shown in Figure 10.22b, where the responses qı (n) 
and q2(n) are due to noise sources e(n) and e2(n), respectively. We can 
combine two noise sources into one. However, to avoid overflow we have 
to scale signals at the input of each adder, which can complicate this 
consolidation of sources. 

In modern DSP chips, the intermediate results of multiply-add op- 
erations are stored in a multiply-accumulate or MAC unit that has 
a double precision register to accumulate sums. The final sum [which 
for Figure 10.22b is at the output of the top adder] is quantized to 
obtain ĝ(n). This implementation not only reduces the total multipli- 
cation quantization noise but also makes the resulting analysis easier. 
Assuming this modern implementation, the resulting simplified model is 
shown in Figure 10.22c, where e(n) is the single noise source that is uni- 
formly distributed between [—2~(8+1),2-(+] and q(n) is the response 
due to e(n). Note that e(n) 4 e;(n)+e2(n) and that q(n) 4 q.(n)+qo(n). 
The only overflow that we have to worry about is at the output of the 
top adder, which can be controlled by scaling the input sequence 2(n) 
as shown in Figure 10.22d. Now the round-off noise analysis can be car- 
ried out in a fashion similar to that of the 1st-order filter. The details, 
however, are more involved due to the impulse response in (10.52). 


Signal-to-noise ratio Referring to Figure 10.22d, the noise impulse 


response he(n) is equal to h(n). Hence the output round-off noise power 
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FIGURE 10.22 2nd-order IIR filter: (a) structure, (b) round-off noise model, 
(c) simplified model, (d) scaled simplified model 


is given by 


loc) 9-2B [oe 
7 E 2 2 
v4 = 02 DO MDP = a DIM) (10.54) 


Since x(n) is quantized, we have |x(n)| < 1. It is then scaled by Xmax to 
avoid overflow in the adder. Hence the output signal power is given by 


< X ax < 
04 = XinexTe >, in = a So lr(n)/? (10.55) 
n=0 n=0 


assuming that x(n) is uniformly distributed over [—1, +1]. Hence the out- 
put SNR is given by 


2 
SNR = 2 = 4 (22) x2, = POHD x2 a (10.56) 
og 
q 
or 
SNRap = 6.02 + 6.02B + 20 logig Xmax (10.57) 
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Following (10.43), (10.44), and (10.45), the scaling factor Xmax is given 
by 
1 
X max = CO 1a AT (10.58) 
Zn |h(n)| 
which is not easy to compute. However, lower and upper bounds on Xmax 
are easy to obtain. From (10.52), the upper bound on the denominator of 


(10.58) is given by 


h(n r” 1)6 ————— 
5i I= ap? ani) ap (l—r) — 


n=0 
(10.59) 
or the lower bound on Xmax is given by 


Xmax > (1-1) sind (10.60) 
The lower bound on the denominator of (10.58) is obtained by noting that 


< So |h(n) 
n=0 


Now from (10.51), the magnitude |H(e)| is given by 


H(e™)| = e 7 


1 
1 — 2rcos(@)e— + r2e—I2" 


Ee) =| 


which has the maximum value at the resonant frequency w = 6, which 
can be easily obtained. Hence 


S > |a(n)| > |H(e”)| = : (10.61) 
= (1 —r)y1 +r? — 2r cos(26) 
or the upper bound on Xmax is given by 
Xmax < (1—1)\/1 + r2 — 2r cos(20) (10.62) 


Substituting (10.60) and (10.62) in (10.56), the output SNR is upper and 
lower bounded by 


22(B+1)(] — r)? sin? 0 < SNR < 27+) (1 —1)?(1+r?—2rcos20) (10.63) 
Substituting 1 — r = ô « 1 and after some simplification, we obtain 
22(B+1) 8? sin? 0 < SNR < 4 (er) §? sin? 0 (10.64) 


or the difference between the upper and lower SNR bounds is about 6 dB. 
Once again the output SNR is directly proportional to B and 6. Fur- 
thermore, it also depends on the angle 0. Some of these observations are 
investigated in Example 10.12. 
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EXAMPLE 10.12 


10.2.7 ANALYSIS USING MATLAB 

We will again simulate round-off errors using the MATLAB function QFix 
with quantization mode ’round’ and overflow mode ’satur’. Since a 
MAC architecture is assumed, we do not have to quantize the intermediate 
results and worry about overflow. Only the final sum needs to be quantized 
with saturation. These operations are also simulated in sequential fashion, 
which has an impact on execution speed. The simulation steps for the 
2nd-order filter are detailed in the following example. 


Consider the model given in Figure 10.22d. We will simulate this model in 
MATLAB and investigate its output error characteristics. Let r = 0.9 and 
0 = 7/3, from which filter parameters are computed and quantized to B bits. 
The input signal is uniformly distributed over the [—1, +1] interval and is also 
quantized to B bits prior to filtering. The scaling factor Xmax is determined 
using (10.58), which can be obtained in MATLAB by computing the impulse 
response for a sufficiently large number of samples. Using 100, 000 signal samples 
and B = 6 bits, the following MATLAB script computes the true output SNR, 
the computed SNR, and the lower and upper bounds of the SNR. 


close all; clc; 


% Example Parameters 


B = 12; 

N = 100000; 
xn = 

r= 


%, # of fractional bits 
% # of samples 


(2*rand(1,N)-1); % Input sequence - Uniform 
0.9; theta = pi/3;% Pole locations 


% Computed Parameters 
pi = r*exp(j*theta); % Poles 


p2 = conj(p1); 


% 


a = poly([p1,p2]); % Filter parameters 

hn = filter(1,a,[1,zeros(1,1000)]); % Imp res 
Xm = 1/sum(abs(hn)); % Scaling factor 

Xm_L = (1-r)*sin(theta); % Lower bound 


Xm_U 


(1-r) *sqrt (1+r*r-2*r*cos(2*theta)); % Upper bound 


¥, Local variables 


bM = 7; DbM = 27bM; % bin parameter 
BB = 2°B; % useful factor in quantization 
M = round(DbM/2) ; % Half number of bins 
bins = [-M+0.5:1:M-0.5]; % Bin values from -M to M 
Q = bins/DbM; % Normalized bins 
YTN = 27(-bM); % Ytick marks interval 
YLM = 4*YTN; % Yaxis limit 


% Quantize the input and the filter coefficients 
xn = QFix(Xm*xn,B,’round’,’satur’); % Scaled Input quant B bits 


a 
al 
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QFix(a,B,’round’,’satur’); % a quantized to B bits 
a(2); a2 = a(3); 
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% Filter output without multiplication quantization 
yn = filter(1,a,xn); % output using filter routine 


% Filter output with multiplication quantization 
yq = zeros(1,N); % Initialize quantized output array 
yq(1) = xn(1); % sample yq(1) 
yq(2) QFix((xn(2)-a1l*yq(1)),B,’round’,’satur’); % sample yq(2) 
for I = 3:N; 
yq(I) = xn(I)-al*yq(I-1)-a2*yq(I-2); % Unquantized sample 
yq(I) = QFix(yq(1),B,’round’,’satur’); % Quantized sample 
end 


% Output Error Analysis 


en = yn-yq; % Output error sequence 
varyn = var(yn); varen = var(en); % Signal and noise power 
eemax = max(en); eemin = min(en); ù% Maximum and minimum of the error 
enmax = max(abs([eemax,eemin] )) ; % Absolute maximum range of the error 
enavg = mean(en); enstd = std(en); ù% Mean and std dev of the error 
en = round(en*(27bM)/(2*enmax)+0.5); % Normalized en (integer between -M & M) 
en = sort([en,-M:1: (M+1)]); % 
H = diff (find(diff (en)))-1; % Error histogram 
H = H/N; % Normalized histogram 
Hmax = max(H); Hmin = min(H); % Max and Min of the normalized histogram 


% Output SNRs 

SNR_C = 10*log10(varyn/varen) ; % Computed SNR 
SNR_T 6.02 + 6.02*B + 20*1lo0g10(Xm) ; % Theoretical SNR 
SNR_L 6.02 + 6.02*B + 20*log10(Xm_L); % Lower SNR bound 
SNR_U = 6.02 + 6.02*B + 20*log10(Xm_U); % Upper SNR bound 


The part of the script not shown above also computes and plots the normalized 
histogram of the output error and prints the statistical values in the plot, as 
shown in Figure 10.23. The error again has a Gaussian distribution. The exact 
value of the output SNR is 25.22 dB, which agrees with the computed value of 
25.11 dB and lies between the lower bound of 20.89 dB and the upper bound 
of 26.47 dB. Similar results done for B = 12 bits are shown in Figure 10.24. 
Again, the simulation results agree with the model results. 


10.2.8 HIGHER-ORDER FILTERS 

The analysis of the quantization effects in a second-order filter can be 
applied directly to higher-order filters based on a parallel realization. 
In this case each 2nd-order filter section is independent of all the other 
sections, and therefore the total quantization noise power at the output 
of the parallel structure is simply the linear sum of the quantization noise 
powers of each of the individual sections. On the other hand, the cascade 
realization is more difficult to analyze because the noise generated in any 
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0.0313 


SAMPLE SIZE N 
RADIAL r 

SNR (THEORY) 
SNR (LOWER) 


100000 ROUNDED TO B 
ANGLE THETA 

SNR (COMPUTED) 

SNR (UPPER) 


0.0234 


0.0156 


Distribution of Output Error 


0.0078 


0.5 0.4 0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 
Normalized Error 


FIGURE 10.23 Multiplication quantization effects in the 1st-order IIR filter in 
Example 10.12, B = 6 bits 


second-order filter section is filtered by the succeeding sections. To min- 
imize the total noise power at the output of the high-order filter, a 
reasonable strategy is to place the sections in the order of decreasing max- 
imum frequency gain. In this case the noise power generated in the early 


0.0313 
SAMPLE SIZE N = 100000 ROUNDED TO B = 12 BITS 
RADIAL r = 0.9 ANGLE THETA = 60 DEG 
SNR(THEORY) = 61.3443 SNR(COMPUTED) = 61.3968 
SNR(LOWER) = 57.0106 SNR(UPPER) = 62.5897 

0.0234 


0.0156 


0.0078 


Distribution of Output Error 


0.5 0.4 0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 
Normalized Error 


FIGURE 10.24 Multiplication quantization effects in the 1st-order IIR filter in 
Example 10.12, B = 12 bits 
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high-gain section is not boosted significantly by the latter sections. Using 
the MATLAB techniques developed in the previous sections, it is easier 
to simulate finite word-length implementations and determine the output 
SNR for a given cascade structure. 


10.2.9 STATISTICAL ROUND-OFF NOISE—FLOATING-POINT 
ARITHMETIC 

As stated in Chapter 6, the floating-point arithmetic gives an error that 

is relative to the magnitude rather than an absolute error. This results in 

a multiplicative noise rather than additive noise—that is, from (6.61) 


Qla(n)] = x(n) + e(n)a(n) = x(n) {1 + e(n)} (10.65) 

with 
-2-? < e(n) < 2P (10.66) 
for a (B+ 1)-bit mantissa. Hence the mean of the relative error is Mme = 0 


and its variance is 
9-2B 


o? = (10.67) 
Since MATLAB is implemented in IEEE-754 floating-point arithmetic, 
all simulations that we perform are IEEE-754 floating-point calculations. 


It is difficult (if not impossible) to simulate an arbitrary floating-point 
arithmetic in MATLAB. Therefore, we give theoretical results only. 


1st-order filter Consider a 1st-order filter as before and shown in Fig- 
ure 10.25a. For the finite word-length analysis with floating-point arith- 
metic we need quantizers after both multiplication and addition to ac- 
count for rounding off in the mantissa, as shown in Figure 10.25b. Hence 
there are two noise sources in the the statistical model as shown in Fig- 
ure 10.25c, where e;(n) is the noise source in the multiplier, e2(n) is the 
noise source in the adder, ĝ(n) is an adder sequence prior to quantization, 
and j(n) is the quantized output. Now 


e(n) = €1(n) a ĝ(n — 1) (10.68a) 
€2(n) = ezln) g(n) (10.68b) 


FIGURE 10.25 First-order IIR filter: (a) structure, (b) finite word-length model 
for floating-point arithmetic, (c) statistical model for floating-point arithmetic 
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where €,(n) and €2(n) are the relative errors in the corresponding quan- 
tizers. The exact analysis even for the 1st-order case is tedious; hence we 
make a few practically reasonable approximations. If the absolute values 
of the errors are small, then we have ĝ(n— 1) ~ y(n—1) and g(n) ~ y(n); 
hence from (10.68a) we obtain 


e(n) x aeq(n) y(n — 1) (10.69a) 
€2(n) © ealn) y(n) (10.69b) 
Furthermore, we make the following assumption about the noise sources: 


1. €,(n) and €2(n) are white noise sources. 

€1(n) and €9(n) are uncorrelated with each other. 

€1(n) and €9(n) are uncorrelated with the input x(n). 

€1(n) and €9(n) are uniformly distributed between —2~? and 272. 


Let x(n) be a zero-mean, stationary random sequence. Then y(n) is 
also a zero-mean, stationary sequence. Hence from (10.69) 


ES ASD 


o = la| o2 oF (10.70a) 
= G0, (10.70b) 


Let the error in the output due e1(n) be qı(n) and that due to e2(n) be 
go(n). Let hı(n) and h2(n) be the corresponding noise impulse responses. 
Note that hy(n) = ha(n) = h(n) = a”u(n). Then the total error q(n) is 


q(n) = qi(n) + go(n) (10.71) 
with 
o? = oi, + Cin (10.72) 
where 


A (10.73) 


q 
QN 
ll 
Q 
S 
> 
Be 
Z 
D% 
B 
Q 
Q 
gn 
ll 
Q 
gn 
> 
N 
Sy 


Hence using (10.72), (10.73), and (10.70), 


1 1 
2 2 2 2 22 2 
= (02, + 02.) (<a = =z) =o, (7 = =z) (lal o, +02,) (10.74) 


Using o2, = 02, = 2-7/3, we obtain 
2-28\ /1+ |a|? 
ee 
om o3( 3 ) (= a5) (10.75) 


= 3 (2°?) (15) (10.76) 


Therefore 
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or 
SNRep = 4.77 + 6.02B + 10log,9(1 — |a|?) — 10log,9(1 + lal?) (10.77) 


which is also a very informative result. Some comments are in order. 


1. The SNR in (10.76) was derived without assuming any input statistics, 
Hence the result is valid for a large class of inputs including white-noise, 
narrow-band, or wide-band signals. The floating-point arithmetic does 
not have to worry about the scaling or limiting input values since it 
can handle a large dynamic range. 

2. Using 0 < 6 = 1 — |a| <1, the SNR in (10.77) can be put in the form 


SNRap © 4.77 + 6.02B + 10 logy(6) = O(8) (10.78) 


This is to be compared with the fixed-point result (10.50) where SNR ~ 
O(67). Thus, the floating-point result is less sensitive to the distance 
of the pole to the unit circle. 

3. In floating-point arithmetic, the output noise variance, On in (10.75) is 
proportional to ož. Thus, if the input signal is scaled up, so is the noise 
variance since o? is also scaled up. Hence the SNR remains constant. 
This again should be compared with the fixed-point case (10.41), in 
which o? is independent of the input signal. Hence if the signal level 
increases, then a, increases, which increases the SNR. 

2nd-order filter Similar analysis can be done for the 2nd-order filter 

with poles close to the unit circle. If the poles are given by reti’, then 

we can show that (see [18]) 


2 +26 
oy op, 46sin 
= 3(2 = ® 0(6 10.79 
( ) 3 + 4cos0 2 ( ) 
where 6 = 1 — r. This again is an approximate result that works very well 
in practice. In this case again, the SNR depends on 6 rather than on 6? 
as in the fixed-point case. 


10.3 ROUND-OFF EFFECTS IN FIR DIGITAL FILTERS 
Se eee 


We will now turn our attention to the finite word-length effects in FIR 
digital filters. As before, we will consider the fixed-point and floating-point 
cases separately. We will then conclude this section with some represen- 
tative examples. 
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10.3.1 FIXED-POINT ARITHMETIC 

We will consider the effects on two realizations: direct-form and cascade- 
form. There is no parallel-form realization for FIR filters since we do 
not have a partial fraction expansion, except for the frequency sampling 
realization, which can be analyzed using IIR filter techniques. The analysis 
of FIR filters is much simpler than that for IIR because there are no 
feedback paths. One consequence of this is the absence of limit cycles. 


Direct-form realization Consider an FIR filter of length M (i.e., 
there are M samples in the impulse response), which is realized using the 
direct form as shown in Figure 10.26a. The filter coefficients are the sam- 
ples of the impulse response h(n). We have to introduce quantizers in the 
vertical branches. If we use the implementation in which each multiplier 
output is quantized, then we obtain the model shown in Figure 10.26b. 
On the other hand if we implement the filter in a typical DSP chip, then 
the final sum is quantized as shown in Figure 10.26c. We will separately 
consider the effects of round-off noise and scaling (to avoid overflow). 


Round-off noise Let the output of the filter in Figure 10.26b due to 
round-off errors be ĝ(n) = y(n) + q(n). Then 


M— 
q(n) = ex(n) (10.80) 


k=0 


= 


where e(n) are the noise sources introduced in each vertical branch to 
account for the rounding operations. Since these noise sources are all 
independent and identical, the noise power in q(n) is given by 


2 — 2 2 pm M 2841) 
ope Df, = Mot =u ( 5 j-i (10.81) 


In Figure 10.26c the output due to the rounding operation is ĝ(n) = 
y(n) + e(n). Hence the noise power in this case is given by 


ages oe (10.82) 
which is smaller by a factor of M compared to (10.81) as expected. 


Scaling to avoid overflow We assume that the fixed-point numbers 
have the two’s-complement form representation, which is a reasonable 
assumption. Then we will have to check only the overflow of the total sum. 
Thus, this analysis is the same for both implementations in Figure 10.26 
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eo(n) i ink e,(N) | Sra 4 e€m-1(N) Í e€m-1(N) 


y(n) + q(n) 


FIGURE 10.26 Direct-form FIR filter: (a) structure, (b) round-off noise model 
with quantizers after each multiplier, (c) round-off noise mode with one quan- 
tizer after the final sum 


and is similar to that for the IIR filter in (10.42)-(10.44). The upper- 
bound on y(n) is obtained as 


WI = [So Ak) x(n = k)| < Xmax Y lAn) (10.83) 
where Xmax is the upper-bound on a(n). To guarantee that |y(n)| < 1, 
we need the scaling factor Xmax on x(n) as 


X max < (10.84) 


= 
> lh(n)| 


which is the most conservative scaling factor. There are other scaling 
factors, depending on the applications—for example, the narrowband 
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signals use 


ET aes EE 
~ max |H(e)| 


and wideband random signals use 
1 


4on/D[h(n)P 


Using (10.84) and assuming that x(n) is uniformly distributed over 
[—Ximax; +Xmax], the input signal power is given by 
X2? 1 
= 5 (10.85) 
3 3 (Do lAn) 
Furthermore, assuming that x(n) is also a white sequence, the output 
signal power is given by 


2 2 2_ 1 D |A(n)/? 
oO. = 0%, J hín) = = > 10.86 


X max < 


Thus, the output SNR is 
92(B+1) 
A 


2 
SNR = 2 = 
q 


È a)l) 


where A = M for the model in Figure 10.26b or A = 1 for the model in 
Figure 10.26c. The corresponding SNR in dB is 


2 
SNRap = 6.02 + 6.02B + 10 logy, (225) — 10logıņo A (10.88) 
(© lk(n))) 


10.3.2 ANALYSIS USING MATLAB 

This simulation in MATLAB can be done in parallel fashion since there 
is no feedback path for the multiplication quantization errors. Using the 
function Qfix function with ’round’ mode, we will compute the quan- 
tized multiplier output. In the case of M quantizers, assuming two’s- 
complement format, we will use the ’twosc’ mode for each quantizer. 
Only the final sum will be quantized and saturated. In the case of one 
quantizer, we need the ’satur’ mode. These simulation steps are detailed 
in the following example. 


EXAMPLE 10.13 Let a fourth-order (M = 5) FIR filter be given by 
H(z) =0.1+0.227' + 0.4277 +0.2277 40.124 (10.89) 


which is implemented as a direct form with B = 12 fractional bit quantiz- 
ers. Compute SNRs for models in Figure 10.26b and c and verify them using 
MATLAB simulations. 
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Solution We will need the quantities X` |h(n)|? and (X> |h(n)|)?. These quantities should 
be computed using 12-bit quantization of the filter coefficients. These values 
using the quantized numbers are $` |h(n)|? = 0.2599 and (X> |h(n)|)? = 1. Using 
(10.88), the output SNR is 65.42 dB for 5 multipliers and is 72.41 dB for 1 
multiplier. The following MATLAB script evaluates these and other quantities. 


% Example Parameters 


B = 12; % # of fractional bits 
N = 100000; 4 # of samples 
xn = (2*rand(1,N)-1); % Input sequence - Uniform Distribution 


h = [0.1,0.2,0.4,0.2,0.1]; % Filter parameters 
M = length(h) ; 


% Local variables 


bM = 7; DbM = 27bM; % bin parameter 
BB = 2°B; % useful factor in quantization 
K = round(DbM/2) ; % Half number of bins 
bins = [-K+0.5:1:K-0.5]; % Bin values from -K to K 
Q = bins/DbM; % Normalized bins 
YTN = 27(-bM); % Ytick marks interval 
YLM = 4*YTN; % Yaxis limit 


% Quantize the input and the filter coefficients 


h = QFix(h,B,’ round’ ,’ satur’); % h quantized to B bits 
Xm = 1/sum(abs(h)); % Scaling factor 
xn = QFix(Xm*xn,B,’round’,’satur’);% Scaled Input quant to B bits 


% Filter output without multiplication quantization 
yn = filter(h,1,xn); % output using filter routine 


% Filter output with multi quant (5 multipliers) 

x1 = [zeros(1,1),xn(1:N-1)]; x2 = [zeros(1,2),xn(1:N-2)]; 
x3 = [zeros(1,3),xn(1:N-3)]; x4 = [zeros(1,4) ,xn(1:N-4)]; 
h0x0 = QFix(h(1)*xn,B,’round’,’twosc’); 

hixi = QFix(h(2)*x1,B,’round’,’twosc’); 

h2x2 = QFix(h(3)*x2,B,’round’,’twosc’); 
QFix(h(4)*x3,B,’round’,’twosc’); 
QFix(h(5)*x4,B,’round’,’twosc’); 

yq = hOx0+h1x1+h2x2+th3x3+h4x4; 

yq = QFix(yq,B,’ round’ ,’ satur’); 


p 5 
P Ww 
ho o 
D Ww 
uon 


% Output Error Analysis 


qn = yn-yq; % Outout error sequence 
varyn = var(yn); varqn = var(qn); % Signal and noise power 
qqmax = max(qn); qqmin = min(qn); % Maximun and minimum of the error 
qnmax = max(abs([qqmax, qqmin] )) ; % Absolute maximum range of the error 


qnavg = mean(qn); qnstd = std(qn); % Mean and std dev of the error 
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qn = round(qn*(2*bM)/(2*qnmax)+0.5); % Normalized en (interger between -K & K) 


qn = sort([qn,-K:1:(K+1)]); h 
H = diff (find(diff(qn)))-1; % Error histogram 
H = H/N; % Normalized histogram 
Hmax = max(H); Hmin = min(H); % Max and Min of the normalized histogram 


% Output SNRs 
SNR_C = 10*log10(varyn/varqn); % Computed SNR 
SNR_T = 6.02 + 6.02*B + 10*log10(sum(h.*h)/Xm72) - 10*log10(M); % Theoretical SNR 


% Filter output with multi quant (1 multiplier) 
yq = QFix(yn,B,’round’,’satur’); 


% Output Error Analysis 


qn = yn-yq; % Outout error sequence 
varyn = var(yn); vargqn = var(qn); % Signal and noise power 
qqmax = max(qn); qqmin = min(qn) ; % Maximun and minimum of the error 
qnmax = max(abs([qqmax,qqmin] )) ; % Absolute maximum range of the error 
qnavg = mean(qn); qnstd = std(qn); % Mean and std dev of the error 
qn = round(qn*(2*bM)/(2*qnmax)+0.5); % Normalized en (interger between -K & K) 
qn = sort([qn,-K:1:(K+1)]); h 
H = diff (find(diff(qn)))-1; % Error histogram 
H = H/N; % Normalized histogram 
Hmax = max(H); Hmin = min(H); % Max and Min of the normalized histogram 


% Output SNRs 
SNR_C = 10*logi0(varyn/varqn); % Computed SNR 
SNR_T = 6.02 + 6.02*B + 10*1log10(sum(h.*h)/Xm~2); % Theoretical SNR 


The computed and theoretical SNRs as well as output error histograms for the 
two models are shown in Figure 10.27. The top plot shows the histogram when 
five multipliers are used. The output error has Gaussian-like distribution with 
SNR equal to 65.42 dB, which agrees with the theoretical value. The bottom 
plot show the histogram when one multiplier is used. As expected, the error is 
uniformly distributed with SNR equal to 72.43 dB, which also agrees with the 
theoretical one. 


Cascade-form realization Let the filter be realized by a cascade of 
K, 2nd-order (M = 3) sections given by 


K 
H(z) =) _ Hi(z) where Hi(z) = Boi + Biz + Boz? (10.90) 
i=1 
as shown in Figure 10.28. The overall length of the filter is M = 2K +1. 
Figure 10.28 also shows the finite word-length model for the cascade form, 
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Five Multipliers 
0.0313 
SAMPLE SIZE N = 100000 ROUNDED TO B 12 BITS 
FILT LENGTH M ERROR MEAN = 1.9514e-007 


5 
SNR (THEORY) 65.4187 SNR (COMPUTED) 65.4241 


0.0234 


Distribution of Output Error 
fo) 
2 
oi 
O 


One Multiplier 


SAMPLE SIZE N = 100000 ROUNDED TO B 12 BITS 
FILT LENGTH M = 5 ERROR MEAN = 1.9514e-007 
SNR (THEORY) 72.4084 SNR (COMPUTED) 72.4324 


Distribution of Output Error 


0 
0.5 0.4 -0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 
Normalized Error 


FIGURE 10.27 Multiplication quantization effects for the direct-form FIR filter 
in Example 10.18 


in which quantization noise sources, e;(n) 1 < i < K, at each section’s 
output are incorporated. Let y(n) be the output due to input x(n), and 
let q(n) be the output due to all noise sources. We make the following 
reasonable assumptions: 


1. The sections are implemented using the MAC (multiply-accumulate) 
architecture so that there is only one independent noise source in each 
section that contributes to e;(n). The other possibility of three multi- 
pliers in each section is straightforward. 


FIGURE 10.28 Cascade form FIR filter structure with noise sources inserted for 
multiplication quantization 
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2. The noise sources are independent of each other—that is, 


ei(n) Lej(n) fori # J 
3. Each noise source is a white noise source with 02, = 2~?? /12. 


We will now consider the issues of round-off noise and scaling (to prevent 
overflow) for the cascade-form realization. 


Round-off noise Let the noise impulse response at the output from 
the e;(n) node be denoted by g;(n). Then the length of g;(n) is equal to 
(M — 2i). Let g;(n) be the output noise due to e;(n). Then its power is 


given by 
M-2i E 2B M-2i 


Sai >. la) rd Igi(n (10.91) 
0 


9-2B K M-2i 


The expression JŽ, >">" |gi(n) |? shows that the error power depends 
on the order of the cascade connections. It has been shown that for the 
majority of the orderings the noise power is approximately the same. 


Scaling to prevent overflow From Figure 10.28 we note that one 
must prevent overflow at each node. Let h(n) be the impulse response 
at each node k; then we need a scaling constant Xmax as 


1 
max, >> |hz(n)| 


so that |y(n)| < 1. Clearly, this is a very conservative value. A better 
approach is to scale the impulse responses of every section {h;(n)} so 
that X` |A;| = 1 for each i. Hence the output of every section is limited 
between —1 and +1 if the input x(n) is distributed over the same interval. 
Assuming that a(n) is uniformly distributed over [—1,+1] and is white, 
the output signal power is 


Xmax = 


M-1 


M-1 
= 02 E hP = 5 D> Ian)? (10.93) 
0 0 


where h(n) is the overall impulse response of the filter. Let g; be the 
corresponding scaled impulse responses in (10.92). Now the output SNR 
can be computed as 


Of a(n) P 
ioe a ln )?) 


SNR = = = 22(B+1) 


(10.94) 


qa 
ae 
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or 
M-1 K M—-2i 
SNRas = 6.02(B+1)+10logy | XC |h(n)|? }—10logig | XC >O linl? 
0 il n=1 


(10.95) 


10.3.3 ANALYSIS USING MATLAB 

Using the casfiltr function, we can compute the output of the infinite- 
precision cascade structure. Using the scaling approach outlined above, 
each second-order section can be scaled and used in the simulation of 
quantized outputs. Again, all calculations can be done in vector fashion, 
which improves the execution speed. These and other simulation steps are 
detailed in the following example. 


EXAMPLE 10.14 Consider the 4th-order FIR filter given in Example 10.13. Its cascade-form 
realization has two sections along with a gain constant bo, which can be obtained 
using the dir2cas function: 


Hı(z) = 1+1.48592 71 +2.890127°, Hə(z) = 1+0.514127*+0.346027°, and bo = 0.1 
(10.96) 
Note that some of these coefficients are greater than 1, which will cause problems 
with coefficient quantization when only B fractional bits are used. Hence we 
need to scale each section as explained. The scaled values are 


Ay (z) = 0.1860 + 0.27642 71 + 0.53762”, Ĥə(z) = 0.5376 + 0.276427 + 0.186027’ 
(10.97) 

and bo = 1. Thus we do not need to scale the input. Now gi(n) = h2(n) and 
ĝ2(n) = 1 in (10.94). Thus, from (10.95) the output SNR is 70.96 dB, which 
compares well with the one-multiplier direct-form implementation (72.41 dB). 


These calculations and error histogram plotting are illustrated in the following 
MATLAB script. 


% Example Parameters 


B = 12; % # of fractional bits 
N = 100000; % # of samples 
xn = (2*rand(1,N)-1); % Input sequence - Uniform Distribution 
h = [0.1,0.2,0.4,0.2,0.1]; % Filter parameters 
M = length(h) ; % Filter length 
[b0,Bh,Ah] = dir2cas(h,1); % Cascade sections 
hi = Bh(1,:); 4, Section-1 
h2 = Bh(2,:); f, Section-2 
hi = hi/sum(h1); % Scaled so Gain=1 
h2 = h2/sum(h2); % Scaled so Gain=1 
% Local variables 
bM = 7; DbM = 27bM; % bin parameter 
BB = 27B; % useful factor in quantization 
K = round(DbM/2) ; % Half number of bins 
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bins = [-K+0.5:1:K-0.5]; % Bin values from -K to K 


Q = bins/DbM; % Normalized bins 
YTN = 27 (-bM); % Ytick marks interval 
YLM = 20*YTN; % Yaxis limit 


% Quantize the input and the filter coefficients 

hi = QFix(h1,B,’round’,’satur’); % hi quantized to B bits 
h2 = QFix(h2,B,’round’,’satur’); % hi quantized to B bits 
xn = QFix(xn,B,’round’,’satur’); % Input quantized to B bits 
% Filter output without multiplication quantization 

yn = casfiltr(b0,Bh,Ah,xn); % output using Casfiltr routine 
% Filter output with multi quant (1 multiplier/section) 

xq = QFix(xn,B,’round’,’satur’); % Section-1 scaled input 
wn = filter(hi,1,xq); % Sec-1 unquantized output 
wq = QFix(wn,B,’round’,’satur’); % Sec-1 quantized output 
wq = QFix(wq,B,’round’,’satur’); % Section-2 scaled input 
yq = filter(h2,1,wq); % Sec-2 unquantized output 
yq = QFix(yq,B,’round’,’satur’); % Sec-2 quantized output 

% Output Error Analysis 


qn = yn-yq; % Outout error sequence 
varyn = var(yn); varqn = var(qn); % Signal and noise power 
qqmax = max(qn); qqmin = min(qn); % Maximun and minimum of the error 
qnmax = max(abs([qqmax, qqmin] )) ; % Absolute maximum range of the error 
qnavg = mean(qn); qnstd = std(qn); % Mean and std dev of the error 
qn = round(qn*(2*bM)/(2*qnmax)+0.5); % Normalized en (interger between -K & K) 
qn = sort([qn,-K:1: (K+1)]); h 
H = diff (find(diff(qn)))-1; % Error histogram 
H = H/N; % Normalized histogram 
Hmax = max(H); Hmin = min(H); % Max and Min of the normalized histogram 


% Output SNRs 
SNR_C = 10*logi0(varyn/varqn); % Computed SNR 
SNR_T = 6.02*(B+1) + 10*1og10(sum(h. *h) ) 

- 10*log10(1+sum(h2.*h2)); % Theoretical SNR 


The plot is shown in Figure 10.29. The error distribution appears to have a 
Gaussian envelope, but the error is not continuously distributed. This behavior 
indicates that the output error takes only a fixed set of values, which is due 
to a particular set of coefficient values. The computed SNR is 70.85 dB, 
which agrees with the above theoretical value. Thus, our assumptions are 
reasonable. 


10.3.4 FLOATING-POINT ARITHMETIC 

Analysis for the floating-point arithmetic is more complicated and tedious. 
Hence we will consider only the direct-form realization with simplified 
assumptions. Figure 10.30 shows a direct-form realization with a floating- 
point arithmetic model. In this realization, {n;(n)}, 1 <i < M — 1 are 
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Cascade Structure 
0.1563 


SAMPLE SIZE N = 100000 ROUNDED TO B 12 BITS 
FILT LENGTH M = 5 ERROR MEAN = 1.9514e-007 
SNR (THEORY) 70.9563 SNR (COMPUTED) 70.8517 


0.1172 


0.0781 


0.0391 


Distribution of output error 


0 g z 
0.5 -0.4 0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 
Normalized error 


FIGURE 10.29 Multiplication quantization effects for the cascade-form FIR 
filter in Example 10.14 


the relative errors in adders and {e;(n)}, 0 < i < M — 1 are the relative 
errors in multipliers, with |n;| < 27°? and |e;| < 2722. 

Let A(n, k) be the gain from the kth multiplier to the output node, 
which is given by 


(1+ ex(n)) TI, (1+ n(n), k £0; 
A(n, k) = (10.98) 
(1+ ¢0(n)) R A +n(n)), k=0. 


Let ĝ(n) £ y(n) + q(n) be the overall output where y(n) is the output 
due to the input x(n) and q(n) is the output due to noise sources. Then 


(10.99) 


o y(n) + q(n) 


‘ 14min 1 +7,(n) 1+ 12) 1+ nmal) 


FIGURE 10.30 Multiplication quantization model for direct-form floating-point 
implementation of an FIR filter 
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Subtracting y(n) = X F h(k) x(n — k) from (10.99), we obtain 


M-1 


= X_{A(n, k) — 1} h(k) a(n — k) (10.100) 


k=0 


Now from (10.98), the average value of A(n, k) is EA(n, k) = 1 and the 
average power of A(n, k) is 


E[A?(n, k)] = (1+ ee k 


—2B 


=1+(M+1-k&) for small 27°? (10.101) 


Assuming that the input signal x(n) is also a white sequence with variance 
o2, then from (10.101) the noise power is given by 


o? = Se au) yP (1- a ) (10.102) 


M+1 
Since (1 — ma) < 1 and using of = 07 D o [h(k )|? the noise power o2 
is upper bounded by 
2 ee 
o <(M+1) z Iy (10.103) 
or the SNR is lower bounded by 
3 
SNR > —— 2°? 10.104 
~ M+1 ( ) 


Equation (10.104) shows that it is best to compute products in order of 
increasing magnitude. 


EXAMPLE 10.15 Again consider the 4th-order FIR filter given in Example 10.13 in which 
M = 5, B = 12, and h(n) = {0.1, 0.2, 0.4, 0.2, 0.1}. From (10.104), the SNR is 
lower bounded by 


SNRas > 10log,, ( a = 69.24 dB 


3 
M+1 
and the approximate value from (10.102) is 71 dB, which is comparable to the 
fixed-point value of 72 dB. Note that the fixed-point results would degrade with 
less than optimum scaling (e.g., if signal amplitude were 10 dB down), whereas 
the floating point SNR would remain the same. To counter this, one could put a 
variable scaling factor A on the fixed-point system, which is then getting close to 
the full floating-point system. In fact, floating-point is nothing but fixed-point 
with variable scaling—that is, a scaling by a power of two (or shifting) at each 
multiplication and addition. 
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10.4 PROBLEMS 
—— gp 


P10.1 Let x(n) = 0.5[cos(n/17) + sin(n/23)]. For the following parts, use 500, 000 samples of 
x(n) and the StatModelR function. 


1. Quantize x(n) to B = 2 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

2. Quantize x(n) to B = 4 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

3. Quantize x(n) to B = 6 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 


P10.2 Let x(n) = į [cos(0.1rn) + sin(0.27n) + sin(0.47n)]. For the following parts use 500, 000 
samples of x(n) and the StatModelR function. 


1. Quantize x(n) to B = 2 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

2. Quantize x(n) to B = 4 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

3. Quantize x(n) to B = 6 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 


P10.3 Let a real, causal, and stable IIR filter be given by 


(10.105) 


3 N-1N-1 x 
Tq 2 Rk Ri 

z2 = fo + [=a 
— Pk 

e k=1 €=1 £ 


P10.4 Consider the lowpass digital filter designed in Problem P6.39. The input to this filter is 
an independent and identically distributed Gaussian sequence with zero-mean and 
variance equal to 0.1. 


1. Determine the variance of the filter output process using the VarGain function. 
2. Determine numerically the variance of the output process by generating 500,000 
samples of the input sequence. Comment on your results. 


P10.5 Design an elliptic bandpass digital filter that has a lower stopband of 0.37, a lower 
passband of 0.47, an upper passband of 0.57, and an upper stopband of 0.657. The 
passband ripple is 0.1 dB and the stopband attenuation is 50 dB. The input signal is a 
random sequence whose components are independent and uniformly distributed between 
—l and 1. 


1. Determine the variance of the filter output process using the VarGain function. 
2. Determine numerically the variance of the output process by generating 500,000 
samples of the input sequence. Comment on your results. 
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P10.6 Consider the 1st-order recursive system y(n) = 0.75 y(n — 1) + 0.1256(n) with zero initial 
conditions. The filter is implemented in 4-bit (including sign) fixed-point 
two’s-complement fractional arithmetic. Products are rounded to 3-bits. 


1. Determine and plot the first 20 samples of the output using saturation limiter for the 
addition. Does the filter go into a limit cycle? 

2. Determine and plot the first 20 samples of the output using two’s-complement overflow 
for the addition. Does the filter go into a limit cycle? 


P10.7 Repeat Problem P10.6 when products are truncated to 3 bits. 


P10.8 Consider the 2nd-order recursive system y(n) = 0.1256(n) — 0.875 y(n — 2) with zero 
initial conditions. The filter is implemented in 5-bit (including sign) fixed-point 
two’s-complement fractional arithmetic. Products are rounded to 4-bits. 


1. Determine and plot the first 30 samples of the output using a saturation limiter for the 
addition. Does the filter go into a limit cycle? 

2. Determine and plot the first 30 samples of the output using two’s-complement overflow 
for the addition. Does the filter go into a limit cycle? 


P10.9 Repeat Problem P10.8 when products are truncated to 4 bits. 


P10.10 Let a(n) = $[sin(n/11) + cos(n/13) + sin(n/17) + cos(n/19)] and c = 0.7777. For the 
following parts use 500,000 samples of x(n) and the StatModelR function. 


1. Quantize cx(n) to B = 4 bits, and plot the resulting distributions for the error signals 
e1(n) and e2(n). Comment on these plots. 

2. Quantize cx(n) to B = 8 bits, and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

3. Quantize cx(n) to B = 12 bits, and plot the resulting distributions for the error signals 
ei(n) and e2(n). Comment on these plots. 


P10.11 Let x(n) = be a random sequence uniformly distributed between —1 and 1, and let 
c = 0.7777. For the following parts, use 500,000 samples of x(n) and the StatModelR 
function. 


1. Quantize cx(n) to B = 4 bits and plot the resulting distributions for the error signals 
e1(n) and e2(n). Comment on these plots. 

2. Quantize cx(n) to B = 8 bits and plot the resulting distributions for the error signals 
e1(m) and e2(n). Comment on these plots. 

3. Quantize cx(n) to B = 12 bits and plot the resulting distributions for the error signals 
e1(n) and e2(n). Comment on these plots. 


P10.12 Consider an LTI system with the input x(n) and output y(n) 
y(n) = box(n) + bi a(n — 1) + ary(n — 1) (10.106) 


1. Draw the direct-form I structure for the above system. 

2. Let e,,(n) denote the multiplication quantization error resulting from the product 
box(n), ev, (n — 1) from the product bız(n — 1), and ea, (n — 1) from the product 
aiy(n — 1) in the direct-form I realization. Draw an equivalent structure that contains 
only one noise source. 

3. Draw an equivalent system that can be used to study multiplication quantization error 
for the system in (10.106). The input to this system should be the noise source in 
part 2, and the output should be the overall output error q(n). 

4. Using the model in part 3, determine an expression for the variance of the output error 


e(n). 
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P10.13 Let the system be given by y(n) = ay(n — 1) + a(n). Let a = 0.7, which is quantized to B 
(fractional) bits in the filter realization. Let the input sequence be x(n) = sin(n/11), 
which is properly scaled to avoid overflow in the adder and quantized to B bits prior to 
filtering. The multiplications in the filtering operations are also quantized to B bits. 


1. Let B = 5. Generate 100,000 samples of x(n), and filter through the system with 
multiplication quantization. Compute the true output, the quantized output, the 
output error, and the output SNR. Provide a plot of normalized histogram, and 
comment on the results. 

2. Let B = 10. Generate 100,000 samples of x(n) and filter through the system with 
multiplication quantization. Compute the true output, the quantized output, the 
output error, and the output SNR. Provide a plot of normalized histogram, and 
comment on the results. 


P10.14 Let the system be given by y(n) = ay(n — 1) + a(n). Let a = 0.333, which is quantized to 
B (fractional) bits in the filter realization. Let the input sequence be x(n) = sin(n/11), 
which is properly scaled to avoid overflow in the adder and quantized to B bits prior to 
filtering. The multiplications in the filtering operations are also quantized to B bits. 


1. Let B = 5. Generate 100,000 samples of x(n), and filter through the system with 
multiplication quantization. Compute the true output, the quantized output, the 
output error, and the output SNR. Provide a plot of normalized histogram and 
comment on the results. 

2. Let B = 10. Generate 100,000 samples of x(n), and filter through the system with 
multiplication quantization. Compute the true output, the quantized output, the 
output error, and the output SNR. Provide a plot of normalized histogram and 
comment on the results. 


P10.15 Consider the 2nd-order IIR filter given in (10.51) with r = 0.8 and 6 = 71/4. The input to 
this filter is x(n) = sin(n/23). 


1. Investigate the multiplication quantization error behavior of this filter for B = 5 bits. 
Determine the true output SNR, the computed output SNR, and the upper and 
lower bounds of the SNR. Plot the normalized histogram of the output error. 

2. Investigate the multiplication quantization error behavior of this filter for B = 10 
bits. Determine the true output SNR, the computed output SNR, and the upper and 
lower bounds of the SNR. Plot the normalized histogram of the output error. 


P10.16 Consider the second-order IIR filter given in (10.51) with r = 0. — 8 and 0 = 27/3. The 
input to this filter is z(n) = sin(n/23). 


1. Investigate the multiplication quantization error behavior of this filter for B = 5 bits. 
Determine the true output SNR, the computed output SNR, and the upper and 
lower bounds of the SNR. Plot the normalized histogram of the output error. 

2. Investigate the multiplication quantization error behavior of this filter for B = 10 bits. 
Determine the true output SNR, the computed output SNR, and the upper and 
lower bounds of the SNR. Plot the normalized histogram of the output error. 


P10.17 Consider a 5th-order FIR system given by 


H(z) = 0.1 + 0.2271 + 0.327? + 0.3273 +. 0.2274 +0.127° 
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which is implemented in a direct form using B = 10 bits. Input to the filter is a random 
sequence whose samples are independent and identically distributed over [—1, 1]. 


1. Investigate the multiplication quantization errors when all 6 multipliers are used in the 
implementation. Provide a plot of the normalized histogram of the output error. 

2. Investigate the multiplication quantization errors when one multiplier is used in the 
implementation. Provide a plot of the normalized histogram of the output error. 


P10.18 Consider a 4th-order FIR system given by 


H(z) = 0.140.227 + 0.3277 + 0.2277 + 0.124 


which is implemented in a cascade form containing second-order sections. Input to the 
filter is a random sequence whose samples are independent and identically distributed 
over [—1, 1]. 


1. Investigate the multiplication quantization errors when B = 6 bits is used in the 
implementation. Provide a plot of the normalized histogram of the output error. 

2. Investigate the multiplication quantization errors when B = 12 bits is used in the 
implementation. Provide a plot of the normalized histogram of the output error. 
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CHAPTER 11 


Applications 
in Adaptive 
Filtering 


In Chapters 7 and 8 we described methods for designing FIR and IIR digi- 
tal filters to satisfy some desired specifications. Our goal was to determine 
the coefficients of the digital filter that met the desired specifications. 

In contrast to the filter design techniques considered in those two 
chapters, there are many digital signal processing applications in which 
the filter coefficients cannot be specified a priori. For example, let us con- 
sider a high-speed modem that is designed to transmit data over telephone 
channels. Such a modem employs a filter called a channel equalizer to com- 
pensate for the channel distortion. The modem must effectively transmit 
data through communication channels that have different frequency re- 
sponse characteristics and hence result in different distortion effects. The 
only way in which this is possible is if the channel equalizer has adjustable 
coefficients that can be optimized to minimize some measure of the dis- 
tortion, on the basis of measurements performed on the characteristics of 
the channel. Such a filter with adjustable parameters is called an adaptive 
filter, in this case an adaptive equalizer. 

Numerous applications of adaptive filters have been described in the 
literature. Some of the more noteworthy applications include (1) adaptive 
antenna systems, in which adaptive filters are used for beam steering and 
for providing nulls in the beam pattern to remove undesired interference 
[29]; (2) digital communication receivers, in which adaptive filters are 
used to provide equalization of intersymbol interference and for channel 


594 
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identification [21]; (3) adaptive noise canceling techniques, in which an 
adaptive filter is used to estimate and eliminate a noise component in 
some desired signal [27, 9, 15]; and (4) system modeling, in which an 
adaptive filter is used as a model to estimate the characteristics of an un- 
known system. These are just a few of the best known examples on the use 
of adaptive filters. 

Although both IIR and FIR filters have been considered for adap- 
tive filtering, the FIR filter is by far the most practical and widely used. 
The reason for this preference is quite simple. The FIR filter has only 
adjustable zeros, and hence it is free of stability problems associated with 
adaptive IIR filters that have adjustable poles as well as zeros. We should 
not conclude, however, that adaptive FIR filters are always stable. On the 
contrary, the stability of the filter depends critically on the algorithm for 
adjusting its coefficients. 

Of the various FIR filter structures that we may use, the direct form 
and the lattice form are the ones often used in adaptive filtering appli- 
cations. The direct form FIR filter structure with adjustable coefficients 
h(0),h(1),..., A(N — 1) is illustrated in Figure 11.1. On the other hand, 
the adjustable parameters in an FIR lattice structure are the reflection 
coefficients Kn shown in Figure 6.18. 

An important consideration in the use of an adaptive filter is the 
criterion for optimizing the adjustable filter parameters. The criterion 
must not only provide a meaningful measure of filter performance, but it 
must also result in a practically realizable algorithm. 

One criterion that provides a good measure of performance in adap- 
tive filtering applications is the least-squares criterion, and its counterpart 
in a statistical formulation of the problem, namely, the mean-square-error 
(MSE) criterion. The least squares (and MSE) criterion results in a qua- 
dratic performance index as a function of the filter coefficients, and hence 
it possesses a single minimum. The resulting algorithms for adjusting the 
coefficients of the filter are relatively easy to implement. 


hah 


Coefficient — 


Input 


Output 


FIGURE 11.1 Direct-form adaptive FIR filter 
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In this chapter we describe a basic algorithm, called the least-mean- 
square (LMS) algorithm, to adaptively adjust the coefficients of an FIR 
filter. The adaptive filter structure that will be implemented is the di- 
rect form FIR filter structure with adjustable coefficients h(0),h(1),..., 
h(N — 1), as illustrated in Figure 11.1. After we describe the LMS algo- 
rithm, we apply it to several practical systems in which adaptive filters 
are employed. 


11.1 LMS ALGORITHM FOR COEFFICIENT ADJUSTMENT 
—— g 


Suppose we have an FIR filter with adjustable coefficients {h(k), 0 < k < 
N — 1}. Let {a(n)} denote the input sequence to the filter, and let the 
corresponding output be {y(n)}, where 


N-1 


y(n) = X` hlk) (n-k), n=0,...,M (11.1) 


k=0 
Suppose that we also have a desired sequence {d(n)} with which we can 


compare the FIR filter output. Then we can form the error sequence 
{e(n)} by taking the difference between d(n) and y(n), that is, 


e(n) =d(n) — y(n), n=0,...,M (11.2) 


The coefficients of the FIR filter will be selected to minimize the sum of 
squared errors. Thus we have 


M M N-1 2 
E= SJ en)=X |din)- X h(k)x(n— k) (11.3) 
n=0 n=0 k=0 
M N-1 N-1N-1 
= SPP (n) — 257 h(k)rasl(k) + h(k)h (0) rza (k — £) 
n=0 k=0 k=0 @=0 
where, by definition, 
M 
ralk) = So d(n)a(n—k), O<k<N-1 (11.4) 
se 
Tea(k) = So a(n)a(n+k), O<k<N-1 (11.5) 
n=0 
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We call {ra.(k)} the crosscorrelation between the desired output sequence 
{d(n)} and the input sequence {x(n)}, and {rz_(k)} is the autocorrelation 
sequence of {x(n)}. 

The sum of squared errors € is a quadratic function of the FIR filter 
coefficients. Consequently, the minimization of € with respect to the filter 
coefficients {h(k)} results in a set of linear equations. By differentiating 
E with respect to each of the filter coefficients, we obtain 


ðE 
=- 5 < < — . 
GD 0, 0<m<N-1 (11.6) 
and hence 
N-1 
XO A(k)ree(k—m) = ram), OSm<N-1 (11.7) 
k= 


This is the set of linear equations that yield the optimum filter coefficients. 

To solve the set of linear equations directly, we must first compute 
the autocorrelation sequence {rzz(k)} of the input signal and the cross- 
correlation sequence {rgz(k)} between the desired sequence {d(n)} and 
the input sequence {x(n)}. 

The LMS algorithm provides an alternative computational method for 
determining the optimum filter coefficients {h(k)} without explicitly com- 
puting the correlation sequences {rzz(k)} and {ra,(k)}. The algorithm is 
basically a recursive gradient (steepest-descent) method that finds the 
minimum of € and thus yields the set of optimum filter coefficients. 

We begin with any arbitrary choice for the initial values of {h(k)}, 
say {ho(k)}. For example, we may begin with ho(k) =0, O<k< N-1. 
Then after each new input sample {x(n)} enters the adaptive FIR filter, 
we compute the corresponding output, say {y(n)}, form the error signal 
e(n) = d(n) — y(n), and update the filter coefficients according to the 
equation 


An(k) = hni(k) + A-e(n)-a(n—k), O<k<N-1, n=0,1,... 
(11.8) 


where A is called the step size parameter, x(n — k) is the sample of the 
input signal located at the kth tap of the filter at time n, and e(n)z (n — k) 
is an approximation (estimate) of the negative of the gradient for the kth 
filter coefficient. This is the LMS recursive algorithm for adjusting the 
filter coefficients adaptively so as to minimize the sum of squared errors €. 
The step size parameter A controls the rate of convergence of the 
algorithm to the optimum solution. A large value of A leads to large step 
size adjustments and thus to rapid convergence, while a small value of 
A results in slower convergence. However, if A is made too large the 
algorithm becomes unstable. To ensure stability, A must be chosen [22] 
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to be in the range 


0<A< (11.9) 


10NP, 
where JN is the length of the adaptive FIR filter and P, is the power in 
the input signal, which can be approximated by 
M 


ee cael ee el 
Pe ma = a (11.10) 


n=0 


The mathematical justification of equations (11.9) and (11.10) and 
the proof that the LMS algorithm leads to the solution for the optimum 
filter coefficients is given in more advanced treatments of adaptive filters. 
The interested reader may refer to the books by Haykin [8] and Proakis 
and Manolakis [23]. 


11.1.1 MATLAB IMPLEMENTATION 

The LMS algorithm (11.8) can easily be implemented in MATLAB. 
Given the input sequence {x(n)}, the desired sequence {d(n)}, step size 
A, and the desired length of the adaptive FIR filter N, we can use 
(11.1), (11.2), and (11.8) to determine the adaptive filter coefficients 
{h(n), 0 <n < N — 1} recursively. This is shown in the following func- 
tion, called lms. 


function [h,y] = 1ms(x,d,delta,N) 

% LMS Algorithm for Coefficient Adjustment 
Of es a a ee 
% [h,y] = 1ms(x,d,delta,N) 


% h = estimated FIR filter 

% y = output array y(n) 

% x = input array x(n) 

h d = desired array d(m), length must be same as x 
% delta = step size 

h N = length of the FIR filter 


M = length(x); y = zeros(1,M); 
h = zeros(1,N); 


for n = N:M 
x1 = x(m:-1:n-N+1); 
y & Jol a al! & 
e=d(n) - y; 
h = h + delta*e*x1; 


end 


In addition, the 1ms function provides the output {y(n)} of the adaptive 
filter. 
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We will apply the LMS algorithm to several practical applications 
involving adaptive filtering. 


11.2 SYSTEM IDENTIFICATION OR SYSTEM MODELING 
—— g 


To formulate the problem, let us refer to Figure 11.2. We have an un- 
known linear system that we wish to identify. The unknown system may 
be an all-zero (FIR) system or a pole-zero (IIR) system. The unknown 
system will be approximated (modeled) by an FIR filter of length N. Both 
the unknown system and the FIR model are connected in parallel and are 
excited by the same input sequence {x(n)}. If {y(n)} denotes the output 
of the model and {d(n)} denotes the output of the unknown system, the 
error sequence is {e(n) = d(n) — y(n) }. If we minimize the sum of squared 
errors, we obtain the same set of linear equations as in (11.7). Therefore, 
the LMS algorithm given by (11.8) may be used to adapt the coefficients of 
the FIR model so that its output approximates the output of the unknown 
system. 


11.2.1 PROJECT 11.1: SYSTEM IDENTIFICATION 
There are three basic modules that are needed to perform this project. 


1. A noise signal generator that generates a sequence of random numbers 
with zero mean value. For example, we may generate a sequence of 
uniformly distributed random numbers over the interval [—a, a]. Such 
a sequence of uniformly distributed numbers has an average value of 
zero and a variance of a?/3. This signal sequence, call it {a(n)}, will be 
used as the input to the unknown system and the adaptive FIR model. 
In this case the input signal {z(n)} has power P, = a?/3. In MATLAB 
this can be implemented using the rand function. 


Unknown 
System 


Noise 
Signal 
Generator 


e(n) 


Adaptive 
FIR Filter 


Error Signal for 
LMS Algorithm 


FIGURE 11.2 Block diagram of system identification or system modeling 
problem 
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2. An unknown system module that may be selected is an IIR filter and 
implemented by its difference equation. For example, we may select an 
IIR filter specified by the second-order difference equation 


d(n) = aid (n — 1) + aod (n — 2) + a(n) + biz (n — 1) + box (n — 2) 
(11.11) 


where the parameters {a1, a2} determine the positions of the poles and 
{b1, b2} determine the positions of the zeros of the filter. These param- 
eters are input variables to the program. This can be implemented by 
the filter function. 

3. An adaptive FIR filter module where the FIR filter has N tap coeffi- 
cients that are adjusted by means of the LMS algorithm. The length 
N of the filter is an input variable to the program. This can be imple- 
mented using the lms function given in the previous section. 


The three modules are configured as shown in Figure 11.2. From this 
project we can determine how closely the impulse response of the FIR 
model approximates the impulse response of the unknown system after 
the LMS algorithm has converged. 

To monitor the convergence rate of the LMS algorithm, we may com- 
pute a short-term average of the squared error e?(n) and plot it. That is, 


we may compute 
ntk 


1 2 
ASE(m) = = >O elk) (11.12) 
k=n+1 
where m = n/K = 1,2,.... The averaging interval K may be selected 


to be (approximately) K = 10N. The effect of the choice of the step 
size parameter A on the convergence rate of the LMS algorithm may be 
observed by monitoring the ASE(m). 

Besides the main part of the program, you should also include, as an 
aside, the computation of the impulse response of the unknown system, 
which can be obtained by exciting the system with a unit sample sequence 
6(n). This actual impulse response can be compared with that of the FIR 
model after convergence of the LMS algorithm. The two impulse responses 
can be plotted for the purpose of comparison. 


11.3 SUPPRESSION OF NARROWBAND INTERFERENCE 


IN A WIDEBAND SIGNAL 
——— ee 


Let us assume that we have a signal sequence {x(n)} that consists of 
a desired wideband signal sequence, say {w(n)}, corrupted by an ad- 
ditive narrowband interference sequence {s(n)}. The two sequences are 
uncorrelated. This problem arises in digital communications and in signal 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


Suppression of Narrowband Interference in a Wideband Signal 601 


detection, where the desired signal sequence {w(n)} is a spread-spectrum 
signal, while the narrowband interference represents a signal from another 
user of the frequency band or some intentional interference from a jammer 
who is trying to disrupt the communication or detection system. 

From a filtering point of view, our objective is to design a filter that 
suppresses the narrowband interference. In effect, such a filter should place 
a notch in the frequency band occupied by the interference. In practice, 
however, the frequency band of the interference might be unknown. More- 
over, the frequency band of the interference may vary slowly in time. 

The narrowband characteristics of the interference allow us to esti- 
mate s(n) from past samples of the sequence x(n) = s(n) + w(n) and to 
subtract the estimate from x(n). Since the bandwidth of {s(n)} is nar- 
row compared to the bandwidth of {w(n)}, the samples of {s(n)} are 
highly correlated. On the other hand, the wideband sequence {w(n)} has 
a relatively narrow correlation. 

The general configuration of the interference suppression system is 
shown in Figure 11.3. The signal x(n) is delayed by D samples, where 
the delay D is chosen sufficiently large so that the wideband signal com- 
ponents w(n) and w(n — D), which are contained in x(n) and x(n — D), 
respectively, are uncorrelated. The output of the adaptive FIR filter is the 


estimate 
N= 


8(n) = X` h(k)a(n — k — D) (11.13) 


k=0 


= 


The error signal that is used in optimizing the FIR filter coefficients is 
e(n) = a(n) — 8(n). The minimization of the sum of squared errors again 
leads to a set of linear equations for determining the optimum coefficients. 
Due to the delay D, the LMS algorithm for adjusting the coefficients 
recursively becomes 


hn(k) = Rn—1(k) + Ae(n)a(n — k — D), A (11.14) 


Desired 


x(n) = s(n) + w(n) Signal 


Decorrelation 
Delay 


eln) = x(n) — S(n) 


FIGURE 11.3 Adaptive filter for estimating and suppressing a narrowband in- 
terference 
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Sine Wave 
Generator 


Noise w(n) 
Generator 


FIGURE 11.4 Configuration of modules for experiment on interference suppres- 
sion 


11.3.1 PROJECT 11.2: SUPPRESSION OF SINUSOIDAL INTERFERENCE 
Three basic modules are required to perform this project. 


1. A noise signal generator module that generates a wideband sequence 
{w(n)} of random numbers with zero mean value. In particular, we may 
generate a sequence of uniformly distributed random numbers using 
the rand function as previously described in the project on system 
identification. The signal power is denoted as Py. 

2. A sinusoidal signal generator module that generates a sine wave se- 
quence s(n) = Asin wọn, where 0 < wo < 7 and A is the signal ampli- 
tude. The power of the sinusoidal sequence is denoted as P,. 

3. An adaptive FIR filter module using the lms function, where the FIR 
filter has N tap coefficients that are adjusted by the LMS algorithm. 
The length N of the filter is an input variable to the program. 


The three modules are configured as shown in Figure 11.4. In this 
project the delay D = 1 is sufficient, since the sequence {w(n)} is a white 
noise (spectrally flat or uncorrelated) sequence. The objective is to adapt 
the FIR filter coefficients and then to investigate the characteristics of the 
adaptive filter. 

It is interesting to select the interference signal to be much stronger 
than the desired signal w(n), for example, P, = 10P,. Note that the 
power P, required in selecting the step size parameter in the LMS algo- 
rithm is P, = P, + Pu. The frequency response characteristic H(e%”) of 
the adaptive FIR filter with coefficients {h(k)} should exhibit a resonant 
peak at the frequency of the interference. The frequency response of the 
interference suppression filter is Hs (ef) = 1 — H(e”), which should then 
exhibit a notch at the frequency of the interference. 

It is interesting to plot the sequences {w(n)}, {s(n)}, and {a(n)}. It 
is also interesting to plot the frequency responses H(e/”) and H,(e%”) 
after the LMS algorithm has converged. The short-time average squared 
error ASE(m), defined by (11.12), may be used to monitor the conver- 
gence characteristics of the LMS algorithm. The effect of the length of 
the adaptive filter on the quality of the estimate should be investigated. 
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The project may be generalized by adding a second sinusoid of a 
different frequency. Then H(e?”) should exhibit two resonant peaks, pro- 
vided the frequencies are sufficiently separated. Investigate the effect of 
the filter length N on the resolution of two closely spaced sinusoids. 


11.4 ADAPTIVE LINE ENHANCEMENT 
—— gp 


In the preceding section we described a method for suppressing a strong 
narrowband interference from a wideband signal. An adaptive line en- 
hancer (ALE) has the same configuration as the interference suppression 
filter in Figure 11.3, except that the objective is different. 

In the adaptive line enhancer, {s(n)} is the desired signal and {w(n)} 
represents a wideband noise component that masks {s(n)}. The desired 
signal {s(n)} may be a spectral line (a pure sinusoid) or a relatively 
narrowband signal. Usually, the power in the wideband signal is greater 
than that in the narrowband signal—that is, Puy > P,. It is apparent that 
the ALE is a self-tuning filter that has a peak in its frequency response 
at the frequency of the input sinusoid or in the frequency band occupied 
by the narrowband signal. By having a narrow bandwidth FIR filter, the 
noise outside the frequency band of the signal is suppressed, and thus 
the spectral line is enhanced in amplitude relative to the noise power in 


{w(n)}- 


11.4.1 PROJECT 11.3: ADAPTIVE LINE ENHANCEMENT 

This project requires the same software modules as those used in the 
project on interference suppression. Hence the description given in 
the preceding section applies directly. One change is that in the ALE, the 
condition is that Py > P,. Second, the output signal from the ALE is 
{s(n)}. Repeat the project described in the previous section under these 
conditions. 


11.5 ADAPTIVE CHANNEL EQUALIZATION 
—— g 


The speed of data transmission over telephone channels is usually limited 
by channel distortion that causes intersymbol interference (ISI). At data 
rates below 2400 bits the ISI is relatively small and is usually not a prob- 
lem in the operation of a modem. However, at data rates above 2400 bits, 
an adaptive equalizer is employed in the modem to compensate for the 
channel distortion and thus to allow for highly reliable high-speed data 
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FIGURE 11.5 Application of adaptive filtering to adaptive channel equalization 


a(n) 


transmission. In telephone channels, filters are used throughout the sys- 
tem to separate signals in different frequency bands. These filters cause 
amplitude and phase distortion. The adaptive equalizer is basically an 
adaptive FIR filter with coefficients that are adjusted by means of the 
LMS algorithm to correct for the channel distortion. 

A block diagram showing the basic elements of a modem transmit- 
ting data over a channel is given in Figure 11.5. Initially, the equalizer 
coefficients are adjusted by transmitting a short training sequence, usu- 
ally less than one second in duration. After the short training period, 
the transmitter begins to transmit the data sequence {a(n)}. To track 
the possible slow time variations in the channel, the equalizer coefficients 
must continue to be adjusted in an adaptive manner while receiving data. 
This is usually accomplished, as illustrated in Figure 11.5, by treating 
the decisions at the output of the decision device as correct and by using 
the decisions in place of the reference {d(n)} to generate the error signal. 
This approach works quite well when decision errors occur infrequently, 
such as less than one error in 100 data symbols. The occasional decision 
errors cause only a small misadjustment in the equalizer coefficients. 


11.5.1 PROJECT 11.4: ADAPTIVE CHANNEL EQUALIZATION 

The objective of this project is to investigate the performance of an adap- 
tive equalizer for data transmission over a channel that causes intersym- 
bol interference. The basic configuration of the system to be simulated 
is shown in Figure 11.6. As we observe, five basic modules are required. 
Note that we have avoided carrier modulation and demodulation, which 
is required in a telephone channel modem. This is done to simplify the 
simulation program. However, all processing involves complex arithmetic 
operations. 
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FIGURE 11.6 Experiment for investigating the performance of an adaptive 
equalizer 


The five modules are as follows: 


1. The data generator module is used to generate a sequence of complex- 
valued information symbols {a(n)}. In particular, employ four equally 
probable symbols s + js, s — js, —s + js, and —s — js, where s is a 
scale factor that may be set to s = 1, or it can be an input parameter. 

2. The channel filter module is an FIR filter with coefficients {c(n), 
0 <n < K —1} that simulates the channel distortion. For distortion- 
less transmission, set c(0) = 1 and c(n) = 0 for 1 < n < K — 1. The 
length K of the filter is an input parameter. 

3. The noise generator module is used to generate additive noise that is 
usually present in any digital communication system. If we are model- 
ing noise that is generated by electronic devices, the noise distribution 
should be Gaussian with zero mean. Use the randu function. 

4. The adaptive equalizer module is an FIR filter with tap coefficients 
{h(k), 0< k< N-—1}, which are adjusted by the LMS algorithm. 
However, due to the use of complex arithmetic, the recursive equation 
in the LMS algorithm is slightly modified to 


hn(k) = hn-1(k) + A e(n)a*(n — k) (11.15) 


where the asterisk denotes the complex conjugate. 
5. The decision device module takes the estimate â(n) and quantizes it 
to one of the four possible signal points on the basis of the following 
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decision rule: 


Re [a(n)] > 0 and Im [â(n) >0 — 1+ 9 
Re [a(n)] > 0 and Im [â(n) <0 — 1-9 
Re [a(n)] < 0 and Im [@(n)] > 0 — -1 +j 
Re [a(n)] < 0 and Im [@(n)] <0 — -1-j 


The effectiveness of the equalizer in suppressing the ISI introduced by 
the channel filter may be seen by plotting the following relevant sequences 
in a two-dimensional (real-imaginary) display. The data generator out- 
put {a(n)} should consist of four points with values +1 + j. The effect 
of channel distortion and additive noise may be viewed by displaying 
the sequence {x(n)} at the input to the equalizer. The effectiveness of 
the adaptive equalizer may be assessed by plotting its output {@(n)} af 
ter convergence of its coefficients. The short-time average squared error 
ASE(n) may also be used to monitor the convergence characteristics of 
the LMS algorithm. Note that a delay must be introduced into the output 
of the data generator to compensate for the delays that the signal encoun- 
ters due to the channel filter and the adaptive equalizer. For example, this 
delay may be set to the largest integer closest to (N + K)/2. Finally, an 
error counter may be used to count the number of symbol errors in the 
received data sequence, and the ratio for the number of errors to the total 
number of symbols (error rate) may be displayed. The error rate may be 
varied by changing the level of the ISI and the level of the additive noise. 

It is suggested that simulations be performed for the following three 
channel conditions: 


a. No ISI: c(0) =1,c(n) =0,1l<n<K-1 
b. Mild ISI: c(0) = 1, e(1) = 0. z 
c. Strong ISI: c(0) = 1, c(1) = 0. 


The measured error rate may be plotted as a function of the signal- 
to-noise ratio (SNR) at the input to the equalizer, where SNR is defined 
as P,/P,, where P, is the signal power, given as P, = s?, and P, is the 
noise power of the sequence at the output of the noise generator. 


2,¢ 
5, ¢ 
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CHAPTER 12 


Applications in 
Communications 


Today MATLAB finds widespread use in the simulation of a variety of 
communication systems. In this chapter we shall focus on several applica- 
tions dealing with waveform representation and coding, especially speech 
coding, and with digital communications. In particular, we shall describe 
several methods for digitizing analog waveforms, with specific application 
to speech coding and transmission. These methods are pulse-code modula- 
tion (PCM), differential PCM and adaptive differential PCM (ADPCM), 
delta modulation (DM) and adaptive delta modulation (ADM), and lin- 
ear predictive coding (LPC). A project is formulated involving each of 
these waveform encoding methods for simulation using MATLAB. 

The last three topics treated in this chapter deal with signal-detection 
applications that are usually encountered in the implementation of a re- 
ceiver in a digital communication system. For each of these topics we 
describe a project that involves the implementations via simulation of the 
detection scheme in MATLAB. 


12.1 PULSE-CODE MODULATION 
—————————_ 


Pulse-code modulation is a method for quantizing an analog signal for 
the purpose of transmitting or storing the signal in digital form. PCM is 
widely used for speech transmission in telephone communications and for 
telemetry systems that employ radio transmission. We shall concentrate 
our attention on the application of PCM to speech signal processing. 


607 
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Speech signals transmitted over telephone channels are usually limited 
in bandwidth to the frequency range below 4 kHz. Hence the Nyquist rate 
for sampling such a signal is less than 8 kHz. In PCM the analog speech 
signal is sampled at the nominal rate of 8 kHz (samples per second), and 
each sample is quantized to one of 2° levels, and represented digitally by 
a sequence of b bits. Thus the bit rate required to transmit the digitized 
speech signal is 8000 b bits per second. 

The quantization process may be modeled mathematically as 


s(n) = s(n) + q(n) (12.1) 


where 5(n) represents the quantized value of s(n), and q(n) represents the 
quantization error, which we treat as an additive noise. Assuming that a 
uniform quantizer is used and the number of levels is sufficiently large, 
the quantization noise is well characterized statistically by the uniform 
probability density function, 


A 
= < < . 
PQ) = a Sta (12.2) 


where the step size of the quantizer is A = 2~°. The mean square value 
of the quantization error is 


E(q) = = = ~ (12.3) 
Measured in decibels, the mean square value of the noise is 
A2 272b 
10 log (3) = 10log ( 12 ) = —6b — 10.8 dB (12.4) 


We observe that the quantization noise decreases by 6 dB/bit used 
in the quantizer. High-quality speech requires a minimum of 12 bits per 
sample and hence a bit rate of 96,000 bits per second (bps). 

Speech signals have the characteristic that small signal amplitudes 
occur more frequently than large signal amplitudes. However, a uniform 
quantizer provides the same spacing between successive levels through- 
out the entire dynamic range of the signal. A better approach is to use 
a nonuniform quantizer, which provides more closely spaced levels at the 
low signal amplitudes and more widely spaced levels at the large signal 
amplitudes. For a nonuniform quantizer with b bits, the resulting quan- 
tization error has a mean square value that is smaller than that given 
by (12.4). A nonuniform quantizer characteristic is usually obtained by 
passing the signal through a nonlinear device that compresses the signal 
amplitude, followed by a uniform quantizer. For example, a logarithmic 
compressor employed in U.S. and Canadian telecommunications systems, 
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called a -law compressor, has an input-output magnitude characteristic 
of the form 
_ In(1 + pls}) 


<1, ly 4 12. 
MES sgn(s); |s| <1, |y| < (12.5) 


where s is the normalized input, y is the normalized output, sgn (-) is the 
sign function, and ys is a parameter that is selected to give the desired 
compression characteristic. 

In the encoding of speech waveforms the value of u = 255 has been 
adopted as a standard in the U.S. and Canada. This value results in about 
a 24 dB reduction in the quantization noise power relative to uniform 
quantization. Consequently, an 8-bit quantizer used in conjunction with 
a u = 255 logarithmic compressor produces the same quality speech as a 
12-bit uniform quantizer with no compression. Thus the compressed PCM 
speech signal has a bit rate of 64,000 bps. 

The logarithmic compressor standard used in European telecommu- 
nication systems is called A-law and is defined as 


1+ln(A 
1+ intAls) i 4 < [a] <1 
a 1+lnA 
y= (12.6) 
AE a 0<ļ|s|< 4 
1+lhnA Í = 7A 


where A is chosen as 87.56. Although (12.5) and (12.6) are different 
nonlinear functions, the two compression characteristics are very similar. 
Figure 12.1 illustrates these two compression functions. Note their strong 
similarity. 


ly| 


FIGURE 12.1 Comparison of u-law and A-law nonlinearities 
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In the reconstruction of the signal from the quantized values, the 
decoder employs an inverse logarithmic relation to expand the signal 
amplitude. For example, in u-law the inverse relation is given by 

(1+ p)lvl—1 


|s| = in eee ly) 2s] 1 (12.7) 


The combined compressor-expander pair is termed a compander. 


12.1.1 PROJECT 12.1: PCM 

The purpose of this project is to gain an understanding of PCM compres- 
sion (linear-to-logarithmic) and PCM expansion (logarithmic-to-linear). 
Write the following three MATLAB functions for this project: 


1. a -law compressor function to implement (12.5) that accepts a zero- 
mean normalized (|s| < 1) signal and produces a compressed zero-mean 
signal with py as a free parameter that can be specified, 

2. a quantizer function that accepts a zero-mean input and produces an 
integer output after b-bit quantization that can be specified, and 

3. a p-law expander to implement (12.7) that accepts an integer input 
and produces a zero-mean output for a specified u parameter. 


For simulation purposes generate a large number of samples (10,000 
or more) of the following sequences: (a) a sawtooth sequence, (b) an expo- 
nential pulse train sequence, (c) a sinusoidal sequence, and (d) a random 
sequence with small variance. Care must be taken to generate nonperiodic 
sequences by choosing their normalized frequencies as irrational numbers 
(i.e., sample values should not repeat). For example, a sinusoidal sequence 
can be generated using 


s(n) = 0.5sin(n/33), 0 <n < 10,000 


From our discussions in Chapter 2, this sequence is nonperiodic, yet it 
has a periodic envelope. Other sequences can also be generated in a sim- 
ilar fashion. Process these signals through the above p-law compressor, 
quantizer, and expander functions as shown in Figure 12.2, and compute 


{s(n)} 
Generate {s(n)} {y(n)} {yaln} {s,(n)} | Plot Original and 
Random >| Reconstructed 
Signals Signal 
-law Quantizer -law 
Compressor b-bits Expander 


FIGURE 12.2 PCM project 
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the signal-to-quantization noise ratio (SQNR) in dB as 


N 

PARTA ) 
N Tje 

Z n=1 (8(7) — s4(n)) 

For different b-bit quantizers, systematically determine the value of yu 


that maximizes the SQNR. Also plot the input and output waveforms 
and comment on the results. 


SQNR = 10log,,) ( 


12.2 DIFFERENTIAL PCM (DPCM) 
—— g 


In PCM each sample of the waveform is encoded independently of all the 
other samples. However, most signals, including speech, sampled at the 
Nyquist rate or faster exhibit significant correlation between successive 
samples. In other words, the average change in amplitude between suc- 
cessive samples is relatively small. Consequently, an encoding scheme that 
exploits the redundancy in the samples will result in a lower bit rate for 
the speech signal. 

A relatively simple solution is to encode the differences between suc- 
cessive samples rather than the samples themselves. Since differences be- 
tween samples are expected to be smaller than the actual sampled ampli- 
tudes, fewer bits are required to represent the differences. A refinement 
of this general approach is to predict the current sample based on the 
previous p samples. To be specific, let s(n) denote the current sample of 
speech and let ŝ(n) denote the predicted value of s(n), defined as 


3(n) = Sai) s(n —4) (12.8) 


i=l 


Thus &(n) is a weighted linear combination of the past p samples, and 
the a(i) are the predictor (filter) coefficients. The a (i) are selected to 
minimize some function of the error between s(n) and 8(n). 

A mathematically and practically convenient error function is the sum 
of squared errors. With this as the performance index for the predictor, 
we select the a (i) to minimize 


N N p 
Ep = Y e(n |s(n) — Dals- i) (12.9) 
= ss (0) -2X a(i) rss (7) +) dali ali) P08 (i— j) 
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where rss (m) is the autocorrelation function of the sampled signal se- 
quence s(n), defined as 


Tss (m) = y s(i)s(i+m) (12.10) 


i=] 


Minimization of €, with respect to the predictor coefficients {a;(n)} re- 
sults in the set of linear equations, called the normal equations, 


X a(i rss (i— j) = rss (J), J=1,2,.p (12.11) 


i=1 
or in the matrix form, 
Ra=r=a=R'r (12.12) 


where R is the autocorrelation matrix, a is the coefficient vector, and r 
is the autocorrelation vector. Thus the values of the predictor coefficients 
are established. 

Having described the method for determining the predictor coeffi- 
cients, let us now consider the block diagram of a practical DPCM system, 
shown in Figure 12.3. In this configuration the predictor is implemented 
with the feedback loop around the quantizer. The input to the predictor 
is denoted as 5(n), which represents the signal sample s(n) modified by 
the quantization process, and the output of the predictor is 


$= J aiim- i) (12.13) 
The difference 
e(n) = s(n) — 3(n) (12.14) 


is the input to the quantizer, and é(n) denotes the output. Each value of 
the quantized prediction error é(n) is encoded into a sequence of binary 


é(n) §(n) = S(n) + &(n) 
To D/A 
Converter 
D 
{a;} 
(a) DPCM Encoder (b) DPCM Decoder 


FIGURE 12.3 Block diagram of a DPCM transcoder: (a) encoder, (b) decoder 
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digits and transmitted over the channel to the receiver. The quantized 
error (n) is also added to the predicted value 3(n) to yield 3(n). 

At the receiver the same predictor that was used at the transmitting 
end is synthesized, and its output 3(n) is added to €(n) to yield 5(n). The 
signal 5(n) is the desired excitation for the predictor and also the desired 
output sequence from which the reconstructed signal 5 (t) is obtained by 
filtering, as shown in Figure 12.3b. 

The use of feedback around the quantizer, as described, ensures that 
the error in 8(n) is simply the quantization error g(n) = č(n) — e(n) 
and that there is no accumulation of previous quantization errors in the 
implementation of the decoder. That is, 


q(n) = &(n) — e(n) = &(n) — s(n) + &(n) = 3(n) — s(n) (12.15) 


Hence 5(n) = s(n) + q(n). This means that the quantized sample s(n) 
differs from the input s(n) by the quantization error q(n) indepen- 
dent of the predictor used. Therefore the quantization errors do not 
accumulate. 

In the DPCM system illustrated in Figure 12.3, the estimate or pre- 
dicted value S(n) of the signal sample s(n) is obtained by taking a linear 
combination of past values §(n—k), k = 1,2,...,p, as indicated by 
(12.13). An improvement in the quality of the estimate is obtained by 
including linearly filtered past values of the quantized error. Specifically, 
the estimate of s(n) may be expressed as 


m 


(n) =) a(n- iY oli) ë (n= i) (12.16) 


i=1 i=1 


where b (i) are the coefficients of the filter for the quantized error sequence 
é(n). The block diagram of the encoder at the transmitter and the decoder 
at the receiver are shown in Figure 12.4. The two sets of coefficients 
a (i) and b (i) are selected to minimize some function of the error e(n) = 
§(n) — s(n), such as the sum of squared errors. 

By using a logarithmic compressor and a 4-bit quantizer for the error 
sequence e(n), DPCM results in high-quality speech at a rate of 32,000 
bps, which is a factor of two lower than logarithmic PCM. 


12.2.1 PROJECT 12.2: DPCM 

The objective of this project is to gain understanding of the DPCM encod- 
ing and decoding operations. For simulation purposes, generate correlated 
random sequences using a pole-zero signal model of the form 


s(n) = a(1)s(n—1)+4+ boz(n) + biz (n — 1) (12.17) 


where x(n) is a zero-mean unit variance Gaussian sequence. This can be 
done using the filter function. The sequences developed in Project 12.1 
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To 
channel 


Linear 
filter 
{bj} 


6(n) s(n) „ ToD/A 


converter 


(b) Decoder 
FIGURE 12.4 DPCM modified by the linearly filtered error sequence 


can also be used for simulation. Develop the following three MATLAB 
modules for this project: 


1. a model predictor function to implement (12.12), given the input signal 
s(n); 

2. a DPCM encoder function to implement the block diagram of Fig- 
ure 12.3a, which accepts a zero-mean input sequence and produces a 
quantized b-bit integer error sequence, where b is a free parameter; and 

3. a DPCM decoder function of Figure 12.3b, which reconstructs the sig- 
nal from the quantized error sequence. 


Experiment with several p-order prediction models for a given signal 
and determine the optimum order. Compare this DPCM implementation 
with the PCM system of Project 12.1 (at the end of the chapter) and 
comment on the results. Extend this implementation to include an mth- 
order moving average filter as indicated in (12.16). 


12.3 ADAPTIVE PCM AND DPCM (ADPCM) 
TEESE S 


In general, the power in a speech signal varies slowly with time. PCM 
and DPCM encoders, however, are designed on the basis that the speech 
signal power is constant, and hence the quantizer is fixed. The efficiency 
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and performance of these encoders can be improved by having them adapt 
to the slowly time-variant power level of the speech signal. 

In both PCM and DPCM the quantization error q(n) resulting from a 
uniform quantizer operating on a slowly varying power level input signal 
will have a time-variant variance (quantization noise power). One im- 
provement that reduces the dynamic range of the quantization noise is 
the use of an adaptive quantizer. 

Adaptive quantizers can be classified as feedforward or feedback. A 
feedforward adaptive quantizer adjusts its step size for each signal sample, 
based on a measurement of the input speech signal variance (power). For 
example, the estimated variance, based as a sliding window estimator, is 


1 n+1 
Ca T >o 8? (k) (12.18) 
k=n+1-M 


Then the step size for the quantizer is 
A (n+ 1) = A(n)én41 (12.19) 


In this case it is necessary to transmit A (n + 1) to the decoder in order 
for it to reconstruct the signal. 

A feedback adaptive quantizer employs the output of the quantizer 
in the adjustment of the step size. In particular, we may set the step size 
as 

A(n+1) = a(n)A(n) (12.20) 


where the scale factor a(n) depends on the previous quantizer output. 
For example, if the previous quantizer output is small, we may select 
a(n) < 1 in order to provide for finer quantization. On the other hand, 
if the quantizer output is large, then the step size should be increased 
to reduce the possibility of signal clipping. Such an algorithm has been 
successfully used in the encoding of speech signals. Figure 12.5 illustrates 
such a (3-bit) quantizer in which the step size is adjusted recursively 
according to the relation 


A(n+1) = A(n) : M(n) 


where M(n) is a multiplication factor whose value depends on the quan- 
tizer level for the sample s(n), and A(n) is the step size of the quantizer for 
processing s(n). Values of the multiplication factors optimized for speech 
encoding have been given by [14]. These values are displayed in Table 12.1 
for 2-, 3-, and 4-bit quantization for PCM and DPCM. 

In DPCM the predictor can also be made adaptive. Thus in ADPCM 
the coefficients of the predictor are changed periodically to reflect the 
changing signal statistics of the speech. The linear equations given by 
(12.11) still apply, but the short-term autocorrelation function of s(n), 
Tss (m) changes with time. 
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FIGURE 12.5 Example of a quantizer with an adaptive step size ([10]) 


12.3.1 ADPCM STANDARD 

Figure 12.6 illustrates, in block diagram form, a 32,000 bps ADPCM 
encoder and decoder that has been adopted as an international (CCITT) 
standard for speech transmission over telephone channels. The ADPCM 
encoder is designed to accept 8-bit PCM compressed signal samples at 
64,000 bps, and by means of adaptive prediction and adaptive 4-bit 
quantization to reduce the bit rate over the channel to 32,000 bps. The 
ADPCM decoder accepts the 32,000 bps data stream and reconstructs 
the signal in the form of an 8-bit compressed PCM at 64,000 bps. Thus we 
have a configuration shown in Figure 12.7, where the ADPCM encoder/ 
decoder is embedded into a PCM system. Although the ADPCM encoder / 


TABLE 12.1 Multiplication factors for adaptive step size adjustment ([9]) 


PCM DPCM 
2 3 4 2 3 4 

M(1) 0.60 0.85 0.80 0.80 0.90 0.90 
M(2) 2.20 1.00 0.80 1.60 0.90 0.90 
M(3) 1.00 0.80 1.25 0.90 
M(4) 1.50 0.80 1.70 0.90 
M(5) 0.80 1.20 
M(6) 0.80 1.60 
M(7) 0.80 2.00 
M(8) 0.80 2.40 
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FIGURE 12.6 ADPCM block diagram 


decoder could be used directly on the speech signal, the interface to the 
PCM system is necessary in practice in order to maintain compatibility 
with existing PCM systems that are widely used in the telephone network. 

The ADPCM encoder accepts the 8-bit PCM compressed signal and 
expands it to a 14-bit-per-sample linear representation for processing. The 
predicted value is subtracted from this 14-bit linear value to produce a 
difference signal sample that is fed to the quantizer. Adaptive quantiza- 
tion is performed on the difference signal to produce a 4-bit output for 
transmission over the channel. 

Both the encoder and decoder update their internal variables, based 
only on the ADPCM values that are generated. Consequently, an ADPCM 


PCM ADPCM 
Encoder Encoder 
PCM ADPCM 
Decoder Decoder 


FIGURE 12.7 ADPCM interface to PCM system 


8-bit/sample 4-bit/sample 


Channel 
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decoder, including an inverse adaptive quantizer, is embedded in the 
encoder so that all internal variables are updated, based on the same 
data. This ensures that the encoder and decoder operate in synchronism 
without the need to transmit any information on the values of internal 
variables. 

The adaptive predictor computes a weighted average of the last six 
dequantized difference values and the last two predicted values. Hence this 
predictor is basically a 2-pole (p = 2) and 6-zero (m = 6) filter governed 
by the difference equation given by (12.16). The filter coefficients are 
updated adaptively for every new input sample. 

At the receiving decoder and at the decoder that is embedded in 
the encoder, the 4-bit transmitted ADPCM value is used to update the 
inverse adaptive quantizer, whose output is a dequantized version of the 
difference signal. This dequantized value is added to the value generated 
by the adaptive predictor to produce the reconstructed speech sample. 
This signal is the output of the decoder, which is converted to compressed 
PCM format at the receiver. 


12.3.2 PROJECT 12.3: ADPCM 

The objective of this project is to gain familiarity with, and understanding 
of, ADPCM and its interface with a PCM encoder/decoder (transcoder). 
As described, the ADPCM transcoder is inserted between the PCM com- 
pressor and the PCM expander as shown in Figure 12.7. Use the already 
developed MATLAB PCM and DPCM modules for this project. 

The input to the PCM-ADPCM transcoder system can be supplied 
from internally generated waveform data files, just as in the case of the 
PCM project. The output of the transcoder can be plotted. Compar- 
isons should be made between the output signal from the PCM-ADPCM 
transcoder with the signal from the PCM transcoder (PCM Project 12.1), 
and with the original input signal. 


12.4 DELTA MODULATION (DM) 
——————— 


Delta modulation may be viewed as a simplified form of DPCM in which 
a 2-level (1-bit) quantizer is used in conjunction with a fixed 1st-order 
predictor. The block diagram of a DM encoder-decoder is shown in 
Figure 12.8. We note that 


3(n) = 5 (n—1) = 8(n—1) +é(n—1) (12.21) 


Since 
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FIGURE 12.8 Block diagram of a delta modulation system 


Decoder 


it follows that 


wr) 


(n) =s(n—1)+q(n-1) (12.22) 


Thus the estimated (predicted) value of s(n) is really the previous sam- 
ple s(n — 1) modified by the quantization noise q (n — 1). We also note 
that the difference equation in (12.21) represents an integrator with an 
input é(n). Hence an equivalent realization of the 1-step predictor is an 
accumulator with an input equal to the quantized error signal é(n). In gen- 
eral, the quantized error signal is scaled by some value, say A4, which is 
called the step size. This equivalent realization is illustrated in Figure 12.9. 
In effect, the encoder shown in Figure 12.9 approximates a waveform s (t) 


Quantizer To 
— a Channel 
Accumulator 
Encoder Ay 
Output 


Ay Decoder 


FIGURE 12.9 An equivalent realization of a delta modulation system 
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FIGURE 12.10 Two types of distortion in the DM encoder 


by a linear staircase function. In order for the approximation to be rela- 
tively good, the waveform s (t) must change slowly relative to the sampling 
rate. This requirement implies that the sampling rate must be several (a 
factor of at least 5) times the Nyquist rate. A lowpass filter is usually 
incorporated into the decoder to smooth out discontinuities in the recon- 
structed signal. 


12.4.1 ADAPTIVE DELTA MODULATION (ADM) 

At any given sampling rate, the performance of the DM encoder is limited 
by two types of distortion as shown in Figure 12.10. One is called slope- 
overload distortion. It is due to the use of a step size A, that is too small to 
follow portions of the waveform that have a steep slope. The second type 
of distortion, called granular noise, results from using a step size that is too 
large in parts of the waveform having a small slope. The need to minimize 
both of these two types of distortion results in conflicting requirements in 
the selection of the step size Aj. 

An alternative solution is to employ a variable size that adapts itself 
to the short-term characteristics of the source signal. That is, the step size 
is increased when the waveform has a steep slope and decreased when the 
waveform has a relatively small slope. 

A variety of methods can be used to set adaptively the step size in 
every iteration. The quantized error sequence é(n) provides a good indica- 
tion of the slope characteristics of the waveform being encoded. When the 
quantized error é(n) is changing signs between successive iterations, this 
is an indication that the slope of the waveform in the locality is relatively 
small. On the other hand, when the waveform has a steep slope, successive 
values of the error é(n) are expected to have identical signs. From these ob- 
servations it is possible to devise algorithms that decrease or increase the 
step size, depending on successive values of é(n). A relatively simple rule 
devised by [13] is to vary adaptively the step size according to the relation 


A(n) = A(n—1) KED n=1,2,... (12.23) 
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FIGURE 12.11 An example of a delta modulation system with adaptive step size 


Decoder 


where K > 1 is a constant that is selected to minimize the total distortion. 
A block diagram of a DM encoder-decoder that incorporates this adaptive 
algorithm is illustrated in Figure 12.11. 

Several other variations of adaptive DM encoding have been inves- 
tigated and described in the technical literature. A particularly effective 
and popular technique first proposed by [6] is called continuously variable 
slope delta modulation (CVSD). In CVSD the adaptive step size parame- 
ter may be expressed as 


A(n) = aA(n-1)+ ky (12.24) 
if €(n), E(n — 1), and ē(n — 2) have the same sign; otherwise 
A(n) = aA(n—-1)+ k2 (12.25) 


The parameters a, kı, and kg are selected such that 0 < a < 1 and 
kı > k2 > 0. For more discussion on this and other variations of adaptive 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


622 Chapter 12 m APPLICATIONS IN COMMUNICATIONS 


DM, the interested reader is referred to the papers by Jayant [14] and 
Flanagan et al. [4] and to the extensive references contained in these 
papers. 


12.4.2 PROJECT 12.4: DM AND ADM 

The purpose of this project is to gain an understanding of delta modula- 
tion and adaptive delta modulation for coding of waveforms. This project 
involves writing MATLAB functions for the DM encoder and decoder as 
shown in Figure 12.9, and for the ADM encoder and decoder shown in 
Figure 12.11. The lowpass filter at the decoder can be implemented as a 
linear-phase FIR filter. For example, a Hanning filter that has the impulse 
response 


h(n) = . h cos (5) | . O<n<N-1 (12.26) 


may be used, where the length N may be selected in the range 5 < N < 15. 

The input to the DM and ADM systems can be supplied from the 
waveforms generated in Project 12.1 except that the sampling rate should 
be higher by a factor of 5 to 10. The output of the decoder can be plotted. 
Comparisons should be made between the output signal from the DM and 
ADM decoders and the original input signal. 


12.5 LINEAR PREDICTIVE CODING (LPC) OF SPEECH 
a ae 


The linear predictive coding (LPC) method for speech analysis and syn- 
thesis is based on modeling the vocal tract as a linear all-pole (IIR) filter 
having the system function 


H(z) = (12.27) 


where p is the number of poles, G is the filter gain, and {ap (k)} are the 
parameters that determine the poles. There are two mutually exclusive 
excitation functions to model voiced and unvoiced speech sounds. On a 
short-time basis, voiced speech is periodic with a fundamental frequency 
Fo, or a pitch period 1/Fo, which depends on the speaker. Thus voiced 
speech is generated by exciting the all-pole filter model by a periodic 
impulse train with a period equal to the desired pitch period. Unvoiced 
speech sounds are generated by exciting the all-pole filter model by the 
output of a random-noise generator. This model is shown in Figure 12.12. 
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FIGURE 12.12 Block diagram model for the generation of a speech signal 


Given a short-time segment of a speech signal, usually about 20 ms 
or 160 samples at an 8 kHz sampling rate, the speech encoder at the 
transmitter must determine the proper excitation function, the pitch pe- 
riod for voiced speech, the gain parameter G, and the coefficients ap (k). 
A block diagram that illustrates the speech encoding system is given in 
Figure 12.13. The parameters of the model are determined adaptively 
from the data and encoded into a binary sequence and transmitted to the 
receiver. At the receiver the speech signal is synthesized from the model 
and the excitation signal. 

The parameters of the all-pole filter model are easily determined from 
the speech samples by means of linear prediction. To be specific, the 
output of the FIR linear prediction filter is 


s(n) = — > ay (k) s(n — k) (12.28) 
k=1 


{ap(k)} 
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FIGURE 12.13 Encoder and decoder for LPC 
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and the corresponding error between the observed sample s(n) and the 
predicted value 8(n) is 


e(n) = s(n) + X` ap (k) s(n — k) (12.29) 


By minimizing the sum of squared errors, that is, 
N N p 2 
E= SJ e?(n) => | s(n) +Y a (k)s(n— k) (12.30) 
n=0 n=0 k=1 
we can determine the pole parameters {ap (k)} of the model. The result 
of differentiating € with respect to each of the parameters and equating 
the result to zero, is a set of p linear equations 


SS a= = m=1,2,...,p (12.31) 
k=1 
where rss (m) is the autocorrelation of the sequence s(n) defined as 
N 
rss (m) = X` s(n)s (n + m) (12.32) 
n=0 


The linear equation (12.31) can be expressed in matrix form as 
Rssa = -Tss (12.33) 


where R,, is a p x p autocorrelation matrix, rss is a p x 1 autocorrelation 
vector, and a is a p x 1 vector of model parameters. Hence 


a = -Rr ss (12.34) 


SS 


These equations can also be solved recursively and most efficiently, with- 
out resorting to matrix inversion, by using the Levinson-Durbin algorithm 
[19]. However, in MATLAB it is convenient to use the matrix inversion. 
The all-pole filter parameters {ap (k)} can be converted to the all-pole 
lattice parameters {K;} (called the reflection coefficients) using the 
MATLAB function dir2latc developed in Chapter 6. 

The gain parameter of the filter can be obtained by noting that its 
input-output equation is 


s(n) =- X ay (k) s(n — k) + Gz(n) (12.35) 


k=1 


where x(n) is the input sequence. Clearly, 
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Then 
N-1 N-1 
@ Y (n) = dS en) (12.36) 
n=0 n=0 
If the input excitation is normalized to unit energy by design, then 
N-1 p 
G? = X` e(n) = rss (0) + X` ap (k) rss (K) (12.37) 
n=0 k=1 


Thus G? is set equal to the residual energy resulting from the least-squares 
optimization. 

Once the LPC coefficients are computed, we can determine whether 
the input speech frame is voiced, and if so, what the pitch is. This is 
accomplished by computing the sequence 


re(n) = X` ra (k) rss (n — k) (12.38) 


ra (k) = 2 ap (i) ap (i + k) (12.39) 


which is the autocorrelation sequence of the prediction coefficients. 
The pitch is detected by finding the peak of the normalized sequence 
re(n)/re (0) in the time interval that corresponds to 3 to 15 ms in the 
20-ms sampling frame. If the value of this peak is at least 0.25, the frame 
of speech is considered voiced with a pitch period equal to the value of 
n = Np, where re (Np) /re (0) is a maximum. If the peak value is less than 
0.25, the frame of speech is considered unvoiced and the pitch is zero. 
The values of the LPC coefficients, the pitch period, and the type of 
excitation are transmitted to the receiver, where the decoder synthesizes 
the speech signal by passing the proper excitation through the all-pole 
filter model of the vocal tract. Typically, the pitch period requires 6 bits, 
and the gain parameter may be represented by 5 bits after its dynamic 
range is compressed logarithmically. If the prediction coefficients were to 
be coded, they would require between 8 to 10 bits per coefficient for accu- 
rate representation. The reason for such high accuracy is that relatively 
small changes in the prediction coefficients result in a large change in the 
pole positions of the filter model. The accuracy requirements are lessened 
by transmitting the reflection coefficients {K;}, which have a smaller dy- 
namic range—that is, |K;| < 1. These are adequately represented by 6 
bits per coefficient. Thus for a 10th-order predictor the total number of 
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bits assigned to the model parameters per frame is 72. If the model pa- 
rameters are changed every 20 psec. the resulting bit rate is 3,600 bps. 
Since the reflection coefficients are usually transmitted to the receiver, the 
synthesis filter at the receiver is implemented as an all-pole lattice filter, 
described in Chapter 6. 


12.5.1 PROJECT 12.5: LPC 

The objective of this project is to analyze a speech signal through an 
LPC coder and then to synthesize it through the corresponding PLC 
decoder. Use several .wav sound files (sampled at 8000 sam/sec rate), 
which are available in MATLAB for this purpose. Divide speech signals 
into short-time segments (with lengths between 120 and 150 samples) and 
process each segment to determine the proper excitation function (voiced 
or unvoiced), the pitch period for voiced speech, the coefficients {ap (k)} 
(p < 10), and the gain G. The decoder that performs the synthesis is an 
all-pole lattice filter whose parameters are the reflection coefficients that 
can be determined from {ap (k)}. The output of this project is a syn- 
thetic speech signal that can be compared with the original speech signal. 
The distortion effects due to LPC analysis/synthesis may be assessed 
qualitatively. 


12.6 DUAL-TONE MULTIFREQUENCY (DTMF) SIGNALS 
—— g 


DTMF is the generic name for push-button telephone signaling that is 
equivalent to the Touch Tone system in use within the Bell System. DTMF 
also finds widespread use in electronic mail systems and telephone banking 
systems in which the user can select options from a menu by sending 
DTMF signals from a telephone. 

In a DTMF signaling system a combination of a high-frequency tone 
and a low-frequency tone represent a specific digit or the characters * 
and #. The eight frequencies are arranged as shown in Figure 12.14, to 
accommodate a total of 16 characters, 12 of which are assigned as shown, 
while the other four are reserved for future use. 

DTMF signals are easily generated in software and detected by means 
of digital filters, also implemented in software, that are tuned to the 8 fre- 
quency tones. Usually, DTMF signals are interfaced to the analog world 
via a codec (coder/decoder) chip or by linear A/D and D/A converters. 
Codec chips contain all the necessary A/D and D/A, sampling, and fil- 
tering circuitry for a bidirectional analog/digital interface. 

The DTMF tones may be generated either mathematically or from 
a look-up table. In a hardware implementation (e.g., in a digital signal 
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Col 1 Col 2 Col 3 Col 4 
1209Hz 1336Hz 1477Hz 1633 Hz 


Row 1 697 Hz 


Row 2 770 Hz 


Row 3 852 Hz 


Row 4 941 Hz 


DTMF digit = Row tone + Column tone 


FIGURE 12.14 DTMF digits 


processor), digital samples of two sine waves are generated mathemati- 
cally, scaled, and added together. The sum is logarithmically compressed 
and sent to the codec for conversion to an analog signal. At an 8 kHz 
sampling rate the hardware must output a sample every 125 ms. In this 
case a sine look-up table is not used because the values of the sine wave 
can be computed quickly without using the large amount of data mem- 
ory that a table look-up would require. For simulation and investigation 
purposes, the look-up table might be a good approach in MATLAB. 

At the receiving end, the logarithmically compressed, 8-bit digital 
data words from the codec are received and logarithmically expanded to 
their 16-bit linear format. Then the tones are detected to decide on the 
transmitted digit. The detection algorithm can be a DFT implementa- 
tion using the FFT algorithm or a filter bank implementation. For the 
relatively small number of tones to be detected, the filter bank implemen- 
tation is more efficient. We now describe the use of the Goertzel algorithm 
to implement the 8 tuned filters. 

Recall from the discussion in Chapter 5 that the DFT of an N-point 
data sequence {x(n)} is 

N-1 
X (k) = So a(n)WH, k=0,1,...,N-1 (12.40) 

n=0 
If the FFT algorithm is used to perform the computation of the DFT, 
the number of computations (complex multiplications and additions) is 
N log, N. In this case we obtain all N values of the DFT at once. However, 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


628 Chapter 12 m APPLICATIONS IN COMMUNICATIONS 


if we desire to compute only M points of the DFT, where M < log, N, 
then a direct computation of the DFT is more efficient. The Goertzel 
algorithm, which is now described, is basically a linear filtering approach 
to the computation of the DFT and provides an alternative to direct 
computation. 


12.6.1 THE GOERTZEL ALGORITHM 

The Goertzel algorithm exploits the periodicity of the phase factors {W$} 
and allows us to express the computation of the DFT as a linear filtering 
operation. Since Wren = 1, we can multiply the DFT by this factor. 


Thus 
N-1 


X (k) = Wy*®¥ X (kb) = So (mW ™ (12.41) 
m=0 
We note that (12.41) is in the form of a convolution. Indeed, if we define 
the sequence y(n) as 


= 


N 
y(n) = X z (m) Wg O ™ (12.42) 


=0 


then it is clear that y(n) is the convolution of the finite-duration input 
sequence x(n) of length N with a filter that has an impulse response 


hy(n) = Wyk" u(n) (12.43) 


The output of this filter at n = N yields the value of the DFT at the 
frequency wk = 27k/N. That is, 


X (k) = ye (2) nan (12.44) 


as can be verified by comparing (12.41) with (12.42). 
The filter with impulse response hg(n) has the system function 


1 


Doan 
N 


(12.45) 


This filter has a pole on the unit circle at the frequency w, = 2rk/N. 
Thus the entire DFT can be computed by passing the block of input data 
into a parallel bank of N single-pole filters (resonators), where each filter 
has a pole at the corresponding frequency of the DFT. 

Instead of performing the computation of the DFT as in (12.42), via 
convolution, we can use the difference equation corresponding to the filter 
given by (12.45) to compute y(n) recursively. Thus we have 


y(n) = Wry" ye (n—1)+2(n), ye (-1) =0 (12.46) 
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x(n) YR (N) = X(k} 


FIGURE 12.15 Realization of two-pole resonator for computing the DFT 


The desired output is X (k) = y(N). To perform this computation, we 
can compute once and store the phase factor Wi 

The complex multiplications and additions inherent in (12.46) can 
be avoided by combining the pairs of resonators possessing complex con- 
jugate poles. This leads to 2-pole filters with system functions of the 
form 

1— Wz! 

~ 1—2cos(2rk/N) z7! + 272 
The realization of the system illustrated in Figure 12.15 is described by 
the difference equations 


Ay (2) (12.47) 


20k 
UR(n 2 cos x Up (n — 1) — vg (nr — 2) + a(n) (12.48) 
yr (nvp(n) — Wor (n — 1) (12.49) 
with initial conditions vz, (—1) = vz (—2) = 0. This is the Goertzel algo- 


rithm. 

The recursive relation in (12.48) is iterated for n = 0,1,...,N, but the 
equation in (12.49) is computed only once, at time n = N. Each iteration 
requires one real multiplication and two additions. Consequently, for a real 
input sequence x(n), this algorithm requires N + 1 real multiplications to 
yield not only X (k) but also, due to symmetry, the value of X (N — k). 

We can now implement the DTMF decoder by use of the Goertzel 
algorithm. Since there are eight possible tones to be detected, we require 
eight filters of the type given by (12.47), with each filter tuned to one of the 
eight frequencies. In the DTMF detector, there is no need to compute the 
complex value X (k); only the magnitude |X (k)| or the magnitude-squared 
value |X(k)|? will suffice. Consequently, the final step in the computation 
of the DFT value involving the numerator term (feedforward part of the 
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filter computation) can be simplified. In particular, we have 


IX (K Hu (N)? = (N) — Wks (N - 1)/° (12.50) 


(N) + v2 (N —1) - (2 cos =) up(N)vuz (N — 1) 


Thus complex-valued arithmetic operations are completely eliminated in 
the DTMF detector. 


12.6.2 PROJECT 12.6: DTMF SIGNALING 

The objective of this project is to gain an understanding of the DTMF 
tone generation software and the DTMF decoding algorithm (the Goertzel 
algorithm). Design the following MATLAB modules: 


l. a tone generation function that accepts an array containing dial- 
ing digits and produces a signal containing appropriate tones (from 
Figure 12.14) of 0.5-second duration for each digit at 8 kHz sampling 
frequency 

2. a dial-tone generator generating samples of (350 + 440) Hz frequency 
at 8 kHz sampling interval for a specified amount of duration 

3. a decoding function to implement (12.50) that accepts a DTMF signal 
and produces an array containing dialing digits 


Generate several dialing list arrays containing a mix of digits and 
dial tones. Experiment with the tone generation and detection modules 
and comment on your observations. Use MATLAB’s sound generation 
capabilities to listen to the tones and to observe the frequency components 
of the generated tones. 


12.7 BINARY DIGITAL COMMUNICATIONS 
eee ee 


Digitized speech signals that have been encoded via PCM, ADPCM, DM, 
and LPC are usually transmitted to the decoder by means of digital modu- 
lation. A binary digital communications system employs two signal wave- 
forms, say s;(t) = s(t) and s2(t) = —s(t), to transmit the binary sequence 
representing the speech signal. The signal waveform s(t), which is nonzero 
over the interval 0 < t < T, is transmitted to the receiver if the data bit is 
a 1, and the signal waveform —s(t), 0 < t < T is transmitted if the data bit 
isa 0. The time interval T is called the signal interval, and the bit rate over 
the channel is R = 1/T bits per second. A typical signal waveform s(t) is 
a rectangular pulse—that is, s(t) = A, 0 < t < T—which has energy A?T. 
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FIGURE 12.16 Model of binary data communications system 


In practice the signal waveforms transmitted over the channel are 
corrupted by additive noise and other types of channel distortions that 
ultimately limit the performance of the communications system. As a 
measure of performance, we normally use the average probability of error, 
which is often called the bit error rate. 


12.7.1 PROJECT 12.7: BINARY DATA COMMUNICATIONS SYSTEM 
The purpose of this project is to investigate the performance of a binary 
data communications system on an additive noise channel by means of 
simulation. The basic configuration of the system to be simulated is shown 
in Figure 12.16. Five MATLAB functions are required. 


1. A binary data generator module that generates a sequence of indepen- 
dent binary digits with equal probability. 

2. A modulator module that maps a binary digit 1 into a sequence of 
M consecutive +1’s, and maps a binary digit 0 into a sequence of M 
consecutive —1’s. Thus the M consecutive +1’s represent a sampled 
version of the rectangular pulse. 

3. A noise generator that generates a sequence of uniformly distributed 
numbers over the interval (—a,a). Each noise sample is added to a 
corresponding signal sample. 

4. A demodulator module that sums the M successive outputs of the 
noise corrupted sequence +1’s or —1’s received from the channel. We 
assume that the demodulator is time synchronized so that it knows the 
beginning and end of each waveform. 

5. A detector and error-counting module. The detector compares the out- 
put of the modulator with zero and decides in favor of 1 if the output 
is greater than zero and in favor of zero if the output is less than zero. 
If the output of the detector does not agree with the transmitted bit 
from the transmitter, an error is counted by the counter. The error rate 
depends on the ratio (called signal-to-noise ratio) of the size of M to 
the additive noise power, which is P, = a?/3. 


The measured error rate can be plotted for different signal-to-noise 
ratios, either by changing M and keeping Pù fixed or vice versa. 
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12.8 SPREAD-SPECTRUM COMMUNICATIONS 
—— gp 


Spread-spectrum signals are often used in the transmission of digital data 
over communication channels that are corrupted by interference due to 
intentional jamming or from other users of the channel (e.g., cellular tele- 
phones and other wireless applications). In applications other than com- 
munications, spread-spectrum signals are used to obtain accurate range 
(time delay) and range rate (velocity) measurements in radar and navi- 
gation. For the sake of brevity we shall limit our discussion to the use of 
spread spectrum for digital communications. Such signals have the char- 
acteristic that their bandwidth is much greater than the information rate 
in bits per second. 

In combatting intentional interference (jamming), it is important to 
the communicators that the jammer who is trying to disrupt their com- 
munication does not have prior knowledge of the signal characteristics. To 
accomplish this, the transmitter introduces an element of unpredictability 
or randomness (pseudo-randomness) in each of the possible transmitted 
signal waveforms, which is known to the intended receiver, but not to the 
jammer. As a consequence, the jammer must transmit an interfering sig- 
nal without knowledge of the pseudo-random characteristics of the desired 
signal. 

Interference from other users arises in multiple-access communica- 
tions systems in which a number of users share a common communications 
channel. At any given time a subset of these users may transmit informa- 
tion simultaneously over a common channel to corresponding receivers. 
The transmitted signals in this common channel may be distinguished 
from one another by superimposing a different pseudo-random pattern, 
called a multiple-access code, in each transmitted signal. Thus a particular 
receiver can recover the transmitted data intended for it by knowing the 
pseudo-random pattern, that is, the key used by the corresponding trans- 
mitter. This type of communication technique, which allows multiple users 
to simultaneously use a common channel for data transmission, is called 
code division multiple access (CDMA). 

The block diagram shown in Figure 12.17 illustrates the basic el- 
ements of a spread-spectrum digital communications system. It differs 
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FIGURE 12.17 Basic spread spectrum digital communications system 
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from a conventional digital communications system by the inclusion of 
two identical pseudo-random pattern generators, one that interfaces with 
the modulator at the transmitting end and the second that interfaces with 
the demodulator at the receiving end. The generators generate a pseudo- 
random or pseudo-noise (PN) binary-valued sequence (+1’s), which is 
impressed on the transmitted signal at the modulator and removed from 
the received signal at the demodulator. 

Synchronization of the PN sequence generated at the demodula- 
tor with the PN sequence contained in the incoming received signal is 
required in order to demodulate the received signal. Initially, prior to the 
transmission of data, synchronization is achieved by transmitting a short 
fixed PN sequence to the receiver for purposes of establishing synchro- 
nization. After time synchronization of the PN generators is established, 
the transmission of data commences. 


12.8.1 PROJECT 12.8: BINARY SPREAD-SPECTRUM 
COMMUNICATIONS 

The objective of this project is to demonstrate the effectiveness of a PN 
spread-spectrum signal in suppressing sinusoidal interference. Let us con- 
sider the binary communication system described in Project 12.7, and let 
us multiply the output of the modulator by a binary (+1) PN sequence. 
The same binary PN sequence is used to multiply the input to the demod- 
ulator and thus to remove the effect of the PN sequence in the desired 
signal. The channel corrupts the transmitted signal by the addition of a 
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FIGURE 12.18 Block diagram of binary PN spread-spectrum system for simula- 
tion experiment 
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wideband noise sequence {w(n)} and a sinusoidal interference sequence 
of the form i(n) = Asinwon, where 0 < wo < m. We may assume that 
A > M, where M is the number of samples per bit from the modula- 
tor. The basic binary spread spectrum-system is shown in Figure 12.18. 
As can be observed, this is just the binary digital communication system 
shown in Figure 12.16, to which we have added the sinusoidal interference 
and the PN sequence generators. The PN sequence may be generated by 
using a random-number generator to generate a sequence of equally prob- 
able +1’s. 

Execute the simulated system with and without the use of the PN 
sequence, and measure the error rate under the condition that A > M 
for different values of M, such as M = 50, 100, 500, 1000. Explain the 
effect of the PN sequence on the sinusoidal interference signal. Thus ex- 
plain why the PN spread-spectrum system outperforms the conventional 
binary communication system in the presence of the sinusoidal jamming 
signal. 
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’ operator, 25 

& operator, 26 

(:) construct, 24 

* operator, 27—28 
.* operator, 26-27 
^ operator, 24 

+ operator, 26 
<= operator, 26 
== operator, 26 


A 


A/D quantization noise, 540-552. See also 
Quantization 
Absolute specifications, FIR filter design, 
306-307 
Adaptive delta modulation (ADM), 622-624 
Adaptive filtering, 596-608 
channel equalization, 605-608 
coefficient adjustment, 598-501 


least-mean square (LMS) algorithm, 598-601 


line enhancement, 605 
MATLAB implementation, 600 
narrowband interference, suppression of, 
602-605 
sinusoidal interference, suppression of, 
604-605 
system identification (modeling), 601—602 
wideband signals, 602-605 
Adaptive PCM and DPCM (ADPCM), 
616-620 
Adders, 214 
Addition, signal operation, 25-26 
afd_butt function, 410-411 
afd_chb1 function, 416—417 
afd_chb2 function, 419-420 
afd_elip function, 423—424 
Allpass filters, 398—400 
Allpass function, 452 
All-pole lattice filters, 244-246 
All-zero lattice filters, 240-244 
Amplitude response, 312, 326-328, 361 


Analog filter design (AFD) tables, 388 
Analog filters, 388-391, 402—425 
Butterworth lowpass, 403—412 
Chebyshev lowpass, 412—421 
design equations, 408-409, 415-416 
elliptic lowpass, 421-425 
frequency response, 389-391 
IIR filter design, 388-391, 402-425 
MATLAB implementation, 405—408, 
410-412, 414-421, 422-424 
phase responses, 424—425 
prototype characteristics, 402-425 
Analog signals, 3-4, 80-97 
aliasing formula, 81 
band-limited, 82-83, 87—90 
digital signal processing (DSP) compared to, 
3-4 
digital-to-analog (D/A) converters, 90-92, 
94-97 
discrete-time Fourier analysis of, 80-97 


impulse train conversion, 87—90, 92-94 
interpolation, 87-97 
MATLAB implementation, 84-87, 92-97 
reconstruction of, 87-97 
sampling, 81-87 
signal processing (ASP), 3-4, 80-97 
sinusoidal, 83-84 

Analog-to-digital transformations, 425-445 
bilinear transformation, 436—444 
Butterworth lowpass filters, 429-431, 

438-439 

Chebyshev lowpass filters, 431—434, 439-442 
design procedure, 427—436, 438-444 
elliptic lowpass filters, 434-435, 442—444 
impulse invariance transformation, 426—436 
matched-z transformation, 444—445 

angle function, 63 

Anticausal sequence, 106 

Antisymmetric impulse response, 231, 311, 

313-314 
Approximation error, 248, 361-364 
Approximation theory, 367 
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Arbitrary absolutely summable sequences, 
75-76 

Attenuation parameter, 389-390 

Auto-correlation, 36, 45 

Autoregressive moving average (ARMA) filter, 
53, 213 


B 


Band-edge frequencies, 308 
Band-limited signals, 82-83, 87-90 
reconstruction of, 87—90 
sampling, 82-83 
Bartlett window, 329 
Bilateral ztransform, 103-107 
bilinear function, 437—438 
Bilinear transformation, 426, 436—444 
Binary bit, 253 
Binary digital data communication, 
632-633 
Binary number representation, 253-260, 
265-266 
Binary point, 262-263 
bin2dec function, 254 
Biquad section structure, 215, 217-218 
Blackman window, 331-332, 338-340 
Block convolution, 184-186 
Bounded-input bounded-output (BIBO) 
stability, 40 
butter function, 459—4650 
Butterworth lowpass filters, 403—412, 429-431, 
438-439, 445-447, 459-460 
bilinear transformation, 438—439 
design equations, 408—409 
frequency-band transformation, 
459-460 
impulse invariance transformation, 429-431 
MATLAB implementation, 405-408, 
410-412, 445-447, 459-460 
buttord function, 446, 459-460 
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Cascade form, 215, 217-221, 229-231, 585-589 
biquad section structure, 215, 217—218 
FIR filters, 229-231, 585-589 
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IIR filters, 215, 217—221 
MATLAB implementation, 218-221, 231, 
588-589 
round-off effect analysis, 585-588 
casfiltr function, 219-220, 588 
cas2dir function, 220, 231 
Causal sequence, 106 
Causality, 40, 125-128 
linear systems, 40 
zdomain stability and, 125-128 
Ceiling function, 197—198 
Channel equalization, 605-608 
cheb1hpf function, 457—458 
chebiord function, 446, 460 
cheb2ord function, 446, 462 
Chebyshev approximation problem, 361, 364 
Chebyshev lowpass filters, 412—421, 431-434, 
439-442, 445, 447—449, 452, 455—458, 460, 
462-463 
bilinear transformation, 439-442 
design equations, 415—416 
frequency-band transformation, 452, 
455-458, 460, 462-463 
impulse invariance transformation, 
431-434 
MATLAB implementation, 414-421, 445, 
447—449, 460, 462-463 
I, passband equiripple response, 412—416 
II, stopband equiripple response, 416—421 
circevod function, 170-171 
circonvt function, 178 
Circular conjugate symmetry, DFT, 168-173 
Circular convolution, DFT, 175-180 
Circular folding, DFT, 166-168 
Circular shifting, DFT, 173-175 
cirshftt function, 174-175, 178 
Code division multiple access (CDMA), 
634 
Codec (coder/decoder) chips, 628 
Coefficient adjustment, adaptive filtering and, 
596, 598-501 
Comb filters, 397-398 
Command window, MATLAB, 6 
Commands, MATLAB control and flow of, 
11-13 
Communications, 609-636 
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adaptive delta modulation (ADM), 622-624 
adaptive PCM and DPCM (ADPCM), 
616-620 
binary digital data, 632-633 
delta modulation (DM), 620-624 
differential pulse-code modulation (DPCM), 
613-616 
dual-tone multifrequency (DTMF) signals, 
628-632 
linear predictive coding (LPC) speech, 
624-628 
pulse-code modulation (PCM), 609-613 
spread-spectrum digital data, 634-636 
Complex frequency, 104 
Complex-valued exponential sequence, 24, 
74-75 
Conjugation, 68, 71-72, 107, 168 
discrete Fourier transform (DFT), 168 
discrete-time Fourier transform (DTFT), 68, 
71-72 
ztransform (complex), 107 
Constant group delay, 511 
Constant phase delay, 510 
Continuous function, 312 
Continuously variable slope delta modulation 
(CVSD), 623-624 
conv function, 43—45, 108, 197—198 
Convolution, 39-47, 68-69, 108-110, 175-187, 
197-200 
block, 184-186 
circular, 175-180 
deconvolution, 109-110 
discrete Fourier transform (DFT), 175-187, 
197-200 
discrete-time Fourier transform (DTFT), 68, 
69 
error analysis using, 182-184 
fast, 197-199 
fast Fourier transform (FFT), 197-200 
folded-and-shifted method, 42 
graphical, 42—43 
high-speed, 199-200 
linear, 180-187 
linear sum, 39—40 


linear time-invariant (LTI) systems, 39-47 
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MATLAB implementation of, 43-45, 47, 
186-187 
overlap-add method, 187 
overlap-save method, 185-187 
periodic, 69 
sequence correlations, 45—47 
z-transform, 108-110 
Correlation of sequences, 36, 45—47 
cos function, 24-25 
cplxcomp function, 224 
cplxpair function, 219, 224 
Cross-correlation, 36, 45—46 
Cubic spline interpolation, 92, 95-97 
Cutoff frequency, 324 


D 


Dead band, 555 
Decibels (dB), relative specifications in, 
307-309 
Decimal number representation, 264 
decimate function, 486-487 
Decimation, 479-488, 510-518 
downsampler, 479—484 
factor D, 479-488, 510-518 
FIR integer, 510-518 
frequency domain representation, 480—484 
ideal, 484—488 
MATLAB implementation, 480, 485-488, 
512-514 
sampling rate decrease, 479—488 
Decimation-in-frequency (DIF-FFT) algorithm, 
189, 195 
Decimation-in-time (DIT-FFT) algorithm, 189, 
194-195 
Deconvolution, ztransform, 109-110 
dec2bin function, 254-256 
Delay element (shifter or memory), 214 
Delta modulation (DM), 620-624 
Denominator polynomial, 105 
Density spectrum, DTFT, 69 
dfs function, 144-146 
dft function, 156-158 
Difference equations, 47-53, 75-80, 128-134 
complete response, 129-131 
digital filters, 52-53 
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frequency response evaluation from, 75-80 
homogeneous solution, 47—48, 130 
linear time-invariant (LTI) systems, 47-53, 
76-80 
MATLAB implementation of, 48-51, 131-134 
natural frequencies, 48 
steady-state response, 75-76, 130 
transient response, 130 
zero-state input and responses, 51-52, 
130-131 
z-transform solution of, 128-134 
Differential pulse-code modulation (DPCM), 
613-616 
Differentiation in zdomain, 108 
Digital filters, 52-53, 305. See also 
Finite-duration impulse response (FIR) 
filter; Infinite-duration impulse 
response (IIR) filter 
Digital prototypes, 450—463 
Digital resonators, 392-395 
Digital signal processing, 1-21 
analog signal processing (ASP) compared to, 
3-4 
applications of, 17—20 
echo generation, 18-19 
echo removal, 19 
MATLAB and, 1-2, 5-17 
method of, 2-3 
musical sound processing, 18 
reverberation, 19-20 
signal analysis, 4 
signal filtering, 4-5 
Digital sinusoidal oscillators, 400—402 
Digital-to-analog (D/A) converters, 90-92, 
94-97 
analog signal reconstruction, 90-92, 
94-97 
cubic spline interpolation, 92, 95-97 
discrete-time Fourier analysis and, 90-92, 
94-97 
first-order-hold (FOH) interpolation, 91-92, 
94-95 
MATLAB implementation, 94-97 
zero-order-hold (ZOH) interpolation, 90-91, 
94-95 


INDEX 


Direct form, 215-217, 229-230, 522-526, 
581-585 
FIR filters, 229-230, 581-585 
FIR sampling rate conversion, 522-526 
IIR filters, 215-217 
MATLAB implementation, 217, 230, 583-585 
round-off effect analysis, 581-585 
Dirichlet function, 153 
dir2cas function, 218-219, 224, 229, 231, 588 
dir2fs function, 236 
dir2ladr function, 247—248 
dir2latc function, 242, 245 
dir2par function, 222-224 
Discontinuous function, 312 
Discrete Fourier series (DFS), 141-150, 169 
DTFT relation to, 148 
inverse (IDFS), 149-150 
MATLAB implementation, 143-146 
matrix, 144 
periodic conjugate symmetry, 169 
periodic sequences, 142-143, 145-146 
z-transform relationship, 146-148 
Discrete Fourier transform (DFT), 141-212 
circular folding, 166-168 
circular shift, 173-175 
conjugation, 168 
convolution, 175-187, 197—200 
discrete Fourier series (DFS), 141-148 
fast Fourier transform (FFT), 187-200 
linear convolution using, 180-187 
linearity property, 166 
MATLAB implementation, 143-146, 153, 
156-160, 186-187, 195-197 
multiplication, 180 
N-point sequence, 154-165 
Parseval’s relation, 180 
symmetry, 168-173 
zdomain sampling and reconstruction, 
149-153 
zero-padding, 159, 161-165 
Discrete systems, see Discrete-time systems 
Discrete-time filters, 213-304 
adder, 214 
delay element (shifter or memory), 214 
error characteristics, 268-274 
filter coefficients, 275-290 
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finite-precision numerical effects for, 251-252 

FIR systems, 229-240, 286-290 

frequency response, quantization effects on, 
282-290 

IIR systems, 215-229, 275-286 

lattice structures, 240-251 

MATLAB implementation, 217, 218-221, 
222-229, 230, 231-233, 236-240, 242-244, 
245-246, 247-251 

multiplier (gain), 214 

number representation, 252-268 

pole-zero locations, quantization effects on, 
275-282 

quantization and, 268-290 

Discrete-time Fourier (DTF) analysis, 59-102 

analog signals, 80-97 

discrete-time Fourier transform (DTFT), 
59-80 

frequency domain and, 74-80 

interpolation, 87-97 

linear time-invariant systems, 74-80 

MATLAB implementation for, 61-66, 84-87, 
92-97 

reconstruction of analog signals, 87-97 

sampling analog signals, 81-87 

unit impulse response, 59 

Discrete-time Fourier transform (DTFT), 
59-80, 148 

arbitrary sequence response, 75—76 

complex exponential response, 74-75 

conjugation, 68, 71-72 

convolution, 68-69 

determination of, 59-60 

DFS relation to, 148 

energy density spectrum, 69 

folding, 68, 72 

frequency domain and, 74-80 

frequency response evaluation, 76-80 

frequency shifting, 68, 70-71 

inverse, 60 

linear time-invariant (LTI) systems, 
74-80 

linearity property, 67, 69-70 

MATLAB implementation, 61-66 

multiplication, 69 

pairs, 66-67 
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periodicity property, 61 
sinusoidal sequence response, 75 
symmetry property, 61, 68, 72-73 
time shifting, 68, 70 
Discrete-time signals, 22-36 
complex-valued exponential sequence, 24 
correlations of sequences, 36 
even and odd synthesis, 34-35 
exponential sequences, 24, 36 
finite-duration sequence, 23 
geometric series, 36 
infinite-duration sequence, 23 
MATLAB representations, 23-32 
number sequence, 22 
operations on sequences, 25-32 
periodic sequence, 25 
random sequences, 25 
real-valued exponential sequence, 24 
sinusoidal sequence, 24—25, 32-33 
unit sample sequence, 23 
unit sample synthesis, 34 
unit step sequence, 23—24 
Discrete-time systems, 36-53 
convolution, 39-47 
difference equations, 47-53 
digital filters, 52-53 
excitation, 36 
linear, 37—40 
linear time-invariant (LTI), 38-53 
MATLAB implementation for, 43—45, 47, 
48-51 
response, 36 
sequence correlations, 45—47 
zero-state input and responses, 51—52 
Divide-and-combine approach, FFT, 191-193 
Downsampler, 479-484 
Dual-tone multifrequency (DTMF) signals, 
628-632 


E 


Echo generation, 18-19 

Echo removal, 19 

ellipord function, 446, 460-461 

Elliptic lowpass filters, 421—425, 434-435, 
442-444, 446, 449, 460-462 
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bilinear transformation, 442—444 
frequency-band transformation, 460—462 
impulse invariance transformation, 434—435 
MATLAB implementation, 422—424, 446, 
449, 460—462 
phase responses, 424—425 
Energy, signal operation, 28 
Energy density spectrum, DTFT, 69 
Energy power spectrum, DFT, 180 
Energy spectrum, DFT, 180 
Error, 182—184, 268-274, 562-580. See also 
Round-off effects 
analysis, 182-184 
linear convolution for, 182-184 


multiplication quantization, 562—580 
quantization, 268-274 
rounding operation, 268, 273-274 
truncation operation, 268-273 

Even and odd synthesis, 34-35 

evenodd function, 34-35 

Excess-2?~1 (biased) number format, 260 

Excitation, 36 

exp function, 24 

Exponential sequences, 24, 36, 74-75 
complex, 24, 74-75 
DTFT representation, 74-75 
frequency domain, response in, 74—75 
geometric series, 36 
real-valued, 24 

Extraripple filters, 367 

Extrema, 361, 365-367 


F 


Fast Fourier transform (FFT), 187—200 
divide-and-combine approach, 191-193 
efficient approach, 188-191 
fast convolutions, 197—199 
high-speed convolutions, 199-200 
MATLAB implementation, 195-197 
radix-2 algorithm, 193-195 

fft function, 195-197 

fftfilt function, 200 

Filter coefficients, 275-290 
FIR filters, 286-290 
frequency response, effects on, 282—290 


INDEX 


IIR filters, 275-286 
pole-zero locations, effects on, 275-282 
quantization of, 275-290 
filter function, 48-52, 109-110, 121, 131-132, 
197, 220, 224, 230 
Filters, 52-53, 213-475 
design, 213, 305-475 
defined, 52 
discrete-time implementation, 213-304 
finite-duration impulse response (FIR), 52, 
213, 229-240, 305-387 
infinite-duration impulse response (IIR), 53, 
213, 215-229, 388-475 
lattice structures, 240-251 
filtic function, 132-133 
find function, 26 
Finite-duration impulse response (FIR) filter, 
52, 213, 229-240, 286-290, 305-387, 
500-522, 522-532, 580-591 
absolute specifications, 306-307 
antisymmetric impulse response, 231, 311, 
314-315 
cascade form, 229-231, 585-589 
design, 213, 305-387, 500-522 
direct form structure, 229-230, 522-526, 
581-585 
fixed-point arithmetic analysis, 581-583, 
585-588 
floating-point arithmetic analysis, 589-591 
frequency response and, 286-290, 
312-315 
frequency-sampling design, 346-360 
frequency-sampling form, 229, 234-240 
integer decimation, 510-518 
integer interpolation, 501-510 
linear-phase form, 229, 231-234 
linear-phase properties, 309-323 
MATLAB analysis for, 583-585, 588-589 
MATLAB implementation, 230, 231-233, 
236-240, 315-317, 334-335, 368-377 
multiple stopbands, 521-522 
optimal ripple design, 360-377 
polyphase structure, 522, 526-529 
quantization of coefficients, 286-290 
rational-factor rate conversion, 518-521 
relative specifications, decibels (dB), 307-309 
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round-off effects, 580-591 
sampling rate conversion, 500-522, 
522-532 
structures for sampling rate conversion, 
522-532 
symmetric impulse response, 231, 310, 
313-314 
time-invariant structures, 529-532 
windowing, 324-346 
zero locations, 317-323 
Finite-duration sequence, 23, 107 
Finite-precision numerical effects, 251-252 
fir1 function, 345-346 
fir2 function, 358-360 
firpm function, 368-369, 502-504, 511-512 
First-order-hold (FOH) interpolation, 91-92, 
94-95 
fix function, 269 
Fixed-point arithmetic, 252-263, 268-274, 
565-569, 581-583, 585-588 
cascade-form realization, 585-588 
direct-form realization, 581-583 
excess-2?—1 (biased) format, 260 
FIR round-off effect analysis, 581-583, 
585-588 
IIR round-off noise analysis, 565-569 
number representation, 252-263 
one’s complement format, 253, 254-256, 262, 
269-271 
quantization error and, 268-274 
round-off analysis, 565-569, 581-583, 
585-588 
rounding operation, 268, 273-274 
scaling to avoid overflow, 581-583 
sign-magnitude format, 253, 254, 262, 269 
signed integers, 253-260 
ten’s complement format, 258-260 
truncation operation, 268-273 
two’s complement format, 253, 256-258, 260, 
262, 271-273 
fliplr function, 27, 242-243 
Floating-point arithmetic, 253, 263-268, 274, 
578-580, 589-591 
FIR round-off effect analysis, 589-591 
IIR round-off noise analysis, 578-580 
mantissa values, 264-267 


Copyright 2010 Cengage Learning. All Rights Reserved. M ay not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eB ook and/or eChapter(s). 


Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage L earning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


643 


number representation, 253, 263-268 
quantization error and, 274 
round-off effect analysis, 578-580, 589-591 
Folded-and-shifted convolution, 42 
Folding, 27, 68, 72, 107, 166-168 
circular, 166-168 
discrete Fourier transform (DFT), 166-168 
discrete-time Fourier transform (DTFT), 68, 
72 
signal operation, 27 
z-transform, 107 
for...end loop, 143, 178 
freqs_m function, 410—411 
Frequency, periodicity in, 33 
Frequency-band tolerances, 308 
Frequency-band transformations, 450—463 
design procedure, 456-459 
digital prototype design, 450-463 
MATLAB implementation, 459-463 
zplane mapping, 450-456 
Frequency domain, 74-80, 175, 325-326, 
489-490, 498 
arbitrary sequence response, 75—76 
circular shifting in, 175 
complex exponential response, 74—75 
DTFT representation, 74-80 
frequency response evaluation, 76-80 
linear time-invariant (LTI) systems, 74-80 
resampled signal representation, 498 
sampling rate conversion relationships, 
480-484, 489-490, 498 
sinusoidal sequence response, 75 
steady-state response, 75-76 
upsampled signal representation, 489-490 
windowing operation in, 325-326 
Frequency resolution, 148 
Frequency response, 76-80, 282-290, 312-315, 
389-391 
analog filters, 389-391 
DTFT evaluation, 76-80 
FIR filters, 286-290, 312-315 
IIR filters, 282-286 
linear FIR filter design, 312-315 
quantization effects on, 282-290 
Frequency sampling, 150, 229, 234-240, 
346-360 
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approximation error, 248 
design, 346-360 
discrete Fourier transform (DFT) and, 150 
FIR filters, 229, 234-240, 346-360 
form, 229, 234-240 
naive design method, 349-350 
optimum equiripple design method, 350-360 
Frequency-selective filters, 305 
Frequency shifting, 68, 70-71, 107 
DTFT, 68, 70-71 
z-transform, 107 
freqz function, 64, 121-123 
freqz_m function, 335 
Functions, MATLAB, 14 
Fundamental period, 25 


G 


Geometric series, discrete-time signals, 36 
Goertzel algorithm, 630-632 

Granular limit cycles, 554-560 

Graphical convolution, 42—43 


H 


Hamming window, 330-331, 343-344 
Hann window, 330, 344-345 
High-speed convolutions, FFT, 199-200 
Homogeneous solution, 47—48 
hsolpsav function, 199-200 


idfs function, 145 
idft function, 156 
IEEE 754 standard, number representation, 
266-268 
ifft function, 196 
imp-invr function, 428-429 
Impulse invariance transformation, 426-436 
Impulse response, 229, 231, 309-315 
antisymmetric, 231, 314-315 
frequency response and, 312-315 
linear FIR filters, 229, 231, 309-311 
symmetric, 231, 313—314 
Impulse train conversion, 87—90, 92-94 
impz function, 48-49, 110 


INDEX 


Indexing operations, MATLAB, 10-11 
Infinite-duration impulse response (IIR) filter, 
53, 53, 213, 215-229, 275-286, 388-475, 
552-580 
allpass filters, 398-400 
analog filters, 389-391 
analog-to-digital transformations, 425—445 
cascade form, 215, 217—221 
comb filters, 397-398 
design, 213, 388—475 
digital resonators, 392-395 
digital sinusoidal oscillators, 400—402 
direct form, 215-217 
fixed-point arithmetic analysis, 565-569 
floating-point arithmetic analysis, 578-580 
frequency-band transformations, 450—463 
frequency response, 282-286, 389-391 
higher-order filters, 576-580 
limit cycles, 540, 553-562 
lowpass filters, 402-463 
MATLAB analysis for, 555-558, 569-576 
MATLAB implementation, 217, 218-221, 
222-229, 405-408, 410-412, 414—424, 
445-450, 459-463 
multiplication quantization error, 562—580 
notch filters, 395-397 
parallel form, 215, 222-229 
pole-zero locations, quantization effects on, 
275-282 
prototype filter characteristics, 402-425 
quantization of coefficients, 275-286 
relative linear scale, 389-390 
round-off effects, 552-580 
statistical round-off noise, 565-576, 578-580 
transformations, 425—445, 450-463 
transposed structure, 217 
Infinite-duration sequence, 23 
Initial-condition input, 131-134 
interp function, 491—494 
Interpolation, 87-97, 152-153, 477—479, 
488—494, 501-510 
analog signal reconstruction, 87—97 
cubic spline, 92, 95-97 
digital-to-analog (D/A) converters, 90-92, 
94-97 
discrete-time Fourier analysis and, 87—97 
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DTFT formula, 152-153 
error, 477-478 
factor I, 477-479, 488-494, 501-510 
FIR integer, 501-510 
first-order-hold (FOH) interpolation, 91-92, 
94-95 
formula, 88-90 
ideal, 490-494 
impulse train conversion, 87—90, 92—94 
MATLAB implementation, 489, 491-494, 
501-507 
sampling rate increase, 479, 488—494 
upsampler, 488—490 
z-domain reconstruction, 152-153 
zero-order-hold (ZOH), 90-91, 94-95 
intfilt function, 502, 516 
Inversion, 60, 112-118, 149-150 
discrete Fourier series (IDFS), 149-150 
discrete-time Fourier transform (IDTFT), 60 
MATLAB implementation, 114-118 
z-transform, 112-118 


K 


Kaiser window, 331-334, 336-338, 340-342 
kaiserord function, 346 


L 


ladr2dir function, 248-249 
ladrfilt function, 249 
latc2dir function, 245 
latcfilt function, 242, 251 
Lattice filter structures, 240-251 
all-zero, 240-244 
all-pole, 244—246 
lattice-ladder, 246-251 
MATLAB implementation, 242—244, 
245-246, 247-251 
Least-mean square (LMS) algorithm, 598-601 
Least-significant bit, 262 
Left-sided sequence, 106 
Levinson-Durbin algorithm, 626 
Limit cycles, 540, 553-562 
behavior, 553-554 
granular, 554-560 
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IIR digital filters, 553-562 
overflow, 554, 560-562 
round-off effects, 540, 553-552 
zero-input, 553 
Line enhancement, adaptive filtering and, 605 
Linear convolution, 180-187 
blocks, 184-186 
discrete Fourier transform (DFT) for, 
180-187 
error analysis using, 182-184 
MATLAB implementation, 186-187 
Linear convolution sum, 39—40 
Linear filtering process, 478—479 
Linear-phase FIR filters, 229, 231-234, 309-323 
amplitude response, 312 
antisymmetric impulse response, 231, 311, 
314-315 
design, 309-323 
frequency response and, 312-315 
impulse response and, 229, 231, 309-311 
MATLAB implementation, 315-317 
structure, 229, 231-234 
symmetric impulse response, 231, 310, 
313-314 
zero locations, 317-323 
Linear predictive coding (LPC) speech, 
624-628 
Linear systems, 37—40 
bounded-input bounded-output (BIBO) 
stability, 40 
causality, 40 
discrete-time, 37—40 
impulse response, 37 
superposition summation, 37 
time-invariant (LTI), 38—40 
time-varying impulse response, 37 
Linear time-invariant (LTI) systems, 38-53, 
74-80 
arbitrary sequence response, 75—76 
bounded-input bounded-output (BIBO) 
stability, 40 
causality, 40 
complex exponential response, 74—75 
convolution, 39-47 
determination of, 38-39 
difference equations, 47-53, 76-80 
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digital filters, 52-53 
discrete-time Fourier transforms (DTFT), 
74-80 

frequency domain and, 74-80 

frequency response evaluation, 76-80 

sequence correlations, 45—47 

sinusoidal sequence response, 75 

zero-state input and responses, 51-52 
Linearity property, 67, 69-70, 107, 166 

discrete Fourier transform (DFT), 166 


discrete-time Fourier transform (DTFT), 67, 


69-70 
z-transform, 107 
lms function, 600 
Lowpass filters, 402—463 
analog prototype filter characteristics, 
402—425 
analog-to-digital transformations, 425—445 
Butterworth, 403-412, 429-431, 438-439, 
445—447, 459-460 


Chebyshev, 412-421, 431-434, 439-442, 445, 


447—449, 452, 455—458, 460, 462-463 
design using MATLAB, 445-450 
digital prototype design, 450-463 


elliptic, 421-425, 434-435, 442-444, 446, 449, 


460-462 
frequency-band transformations, 450—463 
MATLAB implementation, 459-463 
zplane mapping, 450-456 


M 


Magnitude response, 75 
Mantissa values, 264-267 
Matched-z transformation, 444—445 


MATLAB, 1-2, 5-17, 23-32, 43-45, 47, 48-51, 


61-66, 84-87, 92-97, 114-118, 120-125, 
131-134, 143-146, 153, 156-160, 186-187 
195-197, 217, 218-233, 236-240, 242-251, 
254-258, 260, 267-268, 315-317, 334-335, 
368-377, 405-408, 410-412, 414-424, 
445-450, 459-463, 480, 485-488, 489, 
491-494, 498-500, 501-507, 512-514, 
519-520, 542-552, 555-558, 569-576, 
583-585, 588-589, 600 


INDEX 


analog filters, 405-408, 410-412, 414-421, 
422-424 

analog signal analysis, 84-87, 92-97 

Butterworth lowpass filters, 405—408, 
410-412, 445-447 

Chebyshev lowpass filters, 414—421, 445, 
447—449 

command window, 6 

control and flow of commands, 11-13 

convolution, 43-45, 47, 186-187 

correlation, 47 

decimation, 480, 485-488, 512-514 

difference equations, 48-51, 131-134 

digital signal processing (DSP) and, 1-2 

discrete Fourier series (DFS), 143-146 

discrete Fourier transform (DFT), 153, 
156-160, 186-187, 195-197 

discrete-time filters, 217, 218-233, 236-240, 
242-251 

discrete-time Fourier analysis, 61-66, 84-87, 
92-97 

discrete-time Fourier transform (DTFT), 
61-66 

discrete-time signals, 23-32 

discrete-time systems, 43—45, 47, 48-51 

elliptic lowpass filters, 422—424, 446, 449 

fast Fourier transform (FFT), 195-197 

FIR filters, 230, 231-233, 236-240, 230, 
231-233, 236-240, 315-317, 334-335, 
368-377 

frequency-band transformations, 459—463 

functions, 14 

IIR filters, 217, 218-221, 222-229, 405-408, 
410-412, 414-424, 445-450, 459-463 

indexing operations, 10-11 

interpolation, 489, 491-494, 501-507 

inverse ztransform, 114-118 

lattice filters, 242—244, 245-246, 247-251 

least-mean-square (LMS) algorithm, 600 

linear convolution, 186-187 

linear-phase FIR filters, 315-317 

lowpass filter design, 445-450 

matrix operations, 8-13 

number representation, 6, 254-258, 260, 
267-268 

operators, 8 
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optimal equiripple design, 368-377 NaN function, 267 
plotting, 14-17 Narrowband interference, suppression of, 
quantization noise analysis, 542-552, 602-605 
569-576 Natural frequencies, 48 
rational factor I/D, 498-500, 519-520 Negative-time sequence, 105 
reconstruction of signals, 92-97, 153 Noise, 540-552, 565-580 
round-off effects, 542-552, 555-558, 569-576, A/D quantization, 540-552 
583-585, 588-589 round-off, 565-580 
sampling rate conversion, 480, 485-488, 489, signal-to-noise ratio, 568-569, 572-574, 
491—494, 498-500, 501-507, 512-514, 579-580 
519-520 Nonperiodic signal, 153 
sampling signals, 84-87 Nonrecursive filters, 52 
scripts, 13 Normalized form, 264 
use of, 5-17 Notch filters, 395-397 
variables in, 7-8 Null space, 104 
windowing operations, 334-335 Number representation, 6, 252—268 
z-transform, 114-118, 120-125, 131-134 binary, 253-260, 265-266 
Matrix operations, MATLAB, 8-13 decimals, 264 
mean function, 548 discrete-time filters, 252-268 
Merging formula, 194 excess-2?—1 (biased) format, 260 
Minimizing approximation error (minimax) fixed-point, 252-263 
problem, 361-364 floating-point, 253, 263-268 
Minimum-phase filter, 391 IEEE 754 standard, 266-268 
Mirror-image symmetry, 391 mantissa values, 264-267 
Mixed-radix algorithm, FFT, 193 MATLAB, 6, 254-258, 260, 267-268 
Moving average (MA) filters, 52 one’s complement format, 253, 254-256, 262 
Multiple access code, 634 real, 261-263 
Multiple stopbands, sampling rate conversion, sign-magnitude format, 253, 254, 262 
521-522 signed integers, 253-260 
Multiplication, 26-27, 69, 108, 180 ten’s complement format, 258-260 
DFT property, 180 two’s complement format, 253, 256-258, 260, 
by-a-ramp, 108 262 
DTFT property, 69 Number sequence, 22 
signal operation, 26-27 Numerator polynomial, 105 
z-transform property, 108 Nyquist component, 169 
Multiplier (filter gain), 214 Nyquist rate, 83 
Multirate digital system processing systems, 
476 
Musical sound processing, 18 O 


oc2sm function, 263, 270 


N Omode function, 556 

One-sided ztransform, 128-130 
N-point sequence, DFT, 154-165 One’s complement number format, 253, 
Naive design method, frequency sampling, 254-256, 262, 269-271 


349-350 OnesComplement function, 256 
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Operators, MATLAB, 8 
Optimal equiripple design, 360-377 
amplitude response, 361 
Chebyshev approximation problem, 
361, 364 
extrema, 361, 365-367 
FIR filter design, 360-377 
MATLAB implementation, 368-377 
minimizing approximation error (minimax) 
problem, 361-364 
Parks-McClellan algorithm, 367-377 
Optimum design method, frequency sampling, 
350-360 
Overflow limit cycles, 554, 560-562 
Overlap-add convolution, 187 
Overlap-save convolution, 185-187 
ovrlpsav function, 186-187 


P 


Parallel form, IIR filters, 222—229 

parfiltr function, 224-225 

Parks-McClellan algorithm, 367-377, 520 

Parseval’s relation, DFT, 180 

par2dir function, 225 

Passband, 306-307 

Periodic conjugate symmetry, DFS, 169 

Periodic convolution, 69 

Periodic sequence, 25, 142-143, 145-146 

Periodic shifting, 172 

Periodic-sinc function, 153 

Periodicity in time and frequency, 33 

Phase response, 75, 424—425 

plot function, 94-95, 163 

Plotting, MATLAB, 14-17 

Pole-zero diagrams, 105 

Pole-zero locations, quantization effects on, 
275-282 

poly function, 116 

Polyphase structure, FIR sampling rate 
conversion, 522, 526-529 

Positive-time sequence, 105 

Power, signal operation, 28 

Power spectrum, DFT, 180 

prod function, 28 


INDEX 


Prototype filters, 402—425, 450-463 
analog, 402—425 
digital, 450-463 

Pseudo-noise (PN), 635-636 

Pulse-code modulation (PCM), 609-613 


Q 


Qcoeff function, 279-280 
Qfix function, 557-562, 569-571, 575-576, 
583-585 

Qmode function, 556 

Quantization, 268-290, 540-552, 562-580 
A/D noise analysis, 540-552 
digital filters, noise through, 549-550 
error characteristics, 268-274, 540-552 
filter coefficients, 275-290 
FIR filters, 286-290 
fixed-point arithmetic, 268-274, 565-569 
floating-point arithmetic, 274 
frequency response, effects on, 282—290 
IIR filters, 275-286, 562-580 
MATLAB analysis for, 542-547, 569-576 
MATLAB implementation of, 548-549, 

550-552 

multiplication error, 562-580 
noise, 540-552 
pole-zero locations, effects on, 275-282 
round-off effects, 540-552, 562-580 
rounding operation, 268, 273-274, 547-548 
statistical model of, 541-542, 547-548 
truncation operation, 268-273, 547-548 


R 


Radix-R algorithm, FFT, 193 

Radix-2 algorithm, FFT, 193-195 

rand function, 25 

Random sequences, 25 

Rational factor I/D, 495-500, 518-521 
FIR filters, 518-521 
MATLAB implementation, 498-500, 519-520 
sampling rate conversion by, 495—500 

Real number representation, 261-263 
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Real-valued exponential sequence, 24 
Reconstruction, 87—97, 152-153 
analog signals, 87-97 
band-limited signals, 82-83, 87—90 
cubic spline interpolation, 92, 95-97 
digital-to-analog (D/A) converters, 90-92, 
94-97 
discrete Fourier transform (DFT) for, 
152-153 
DTFT interpolation formula, 152-153 
first-order-hold (FOH) interpolation, 91-92, 
94-95 
impulse train conversion, 87—90, 92-94 
interpolation, 87-97, 152-153 
MATLAB implementation, 92-97, 153 
zdomain, 152-153 
zero-order-hold (ZOH) interpolation, 90-91, 
94-95 
Rectangular pulse, 35 
Rectangular window, 325-329 
Recursive filters, 53, 213 
Region of convergence (ROC), 104-107 
Relative linear scale, 389-390 
Relative specifications, FIR filter design, 
307-309 
rem function, 154-156 
resample function, 499, 522 
residue function, 428—429, 551 
residuez function, 114-118, 124, 224-225, 
428—429 
Resonator, 392 
Response, 36 
Reverberation, 19-20 
Right-sided sequence, 106 
Ripple parameter, 389-390, 515-516 
roots function, 50, 119 
Round-off effects, 540-595 
A/D quantization noise, 540-552 
FIR digital filters, 580-591 
fixed-point arithmetic analysis, 565-569, 
581-583, 585-588 
floating-point arithmetic analysis, 578-580, 
589-591 
higher-order filters, 576-580 
IIR digital filters, 552-580 
limit cycles, 540, 553-562 
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MATLAB analysis for, 542-547, 555-558, 
569-576, 583-585, 588-589 
MATLAB implementation, 548-552 
multiplication quantization error, 562—580 
noise, 540-552, 565-581 
statistical noise, 565-576, 578-580 
Rounding operation, 268, 273-274, 547-548 


S 


Sample delay, 324 

Sample products, signal operation, 28 

Sample shifting, ztransform, 107 

Sample summation, signal operation, 28 

Sampling, 32-33, 81-87, 148-152, 346-360 
aliasing formula, 81 


analog signals, 81-87 

band-limited signals, 82-83 

discrete Fourier transform (DFT) for, 
149-152 

FIR filter design, 346-360 

frequency, 150, 346-360 

interval, 81, 148 

MATLAB implementation, 84-87, 92-97 

sinusoidal sequences, 32-33 

sinusoidal signals, 83-84 

zdomain, 149-152 

Sampling rate conversion, 476-539 

decimation by factor D, 479-488 

FIR filter design for, 500-522 

FIR filter structures for, 522-532 

frequency domain relationships, 480—484, 
489-490, 498 

interpolation by factor I, 477-479, 488-494 

linear filtering process, 478—479 

MATLAB implementation, 480, 485-488, 
489, 491-494, 498-500, 501-507, 512-514, 
519-520 

rational factor I/D, 495-500 

Scaling, signal operation, 27 


Scaling factor, 261 

Scripts, MATLAB, 13 
sdir2cas function, 406-408 
Sensitivity formula, 276 
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Sequences, 22-33, 36, 45-47, 75-76, 103-107, 
142-143, 145-146, 154-156 
anticausal, 106 
arbitrary absolutely summable, 75-76 
complex-valued exponential sequence, 24 


convolution and, 45—47 
correlations of, 36, 45—47 
DFS representation, 142-143, 145-146 
DFT representation, 154-165 
discrete-time signals, 22-33, 36 
DTFT representation, 75-76 
exponential, 24, 36 
finite-duration, 23, 107 
frequency domain, responses in, 75—76 
infinite-duration, 23 
left-sided, 106 
MATLAB representation of, 47 
negative-time, 105-106 
N-point, 154-165 
number, 22 
operations on, 25-32 
periodic, 25, 142-143, 145-146 
positive-time, 105 
random, 25 
real-valued exponential, 24 
region of convergence (ROC), 105-107 
right-sided, 106 
sinusoidal, 24—25, 32-33, 75 
two-sided, 106-107 
unit sample, 23 
unit step, 23-24 
ztransforms, 103-107 

Shifting, 27, 68, 70-71, 107, 173-175 
circular, 173-175 
discrete Fourier transform (DFT), 

173-175 
discrete-time Fourier transform (DTFT), 68, 
70-71 

frequency, 68, 70-71, 107 
periodic, 172 
sample, 107 
signal operation, 27 
time, 68, 70 
z-transform, 107 

sig* functions, 30-31 

sigadd function, 26, 30 


INDEX 


sigfold function, 27, 31 
sigmult function, 26-27, 31 
Sign-magnitude number format, 253, 254, 262, 
269 
Signal-to-noise ratio, 568-569, 572-574, 
579-580 
Signals, 1-23, 25-33, 36, 80-97, 149-153, 
346-360, 507-510 
addition, 25-26 
analog processing (ASP), 3-4, 80-97 
analysis, 4 
band-limited, 82-83, 87-90 
digital processing (DSP), 1-21 
discrete Fourier transform (DFT) for, 
149-153 
discrete-time, 22-33, 36 
discrete-time Fourier analysis of, 80-97 
filtering, 4-5 
folding, 27 
multiplication, 26-27 
operations, 25-32 
parameters, 507-510 
reconstruction, 87-97, 152-153 
sample products, 28 
sample summation, 28 
sampling, 32-33, 81-87, 149-152, 
346-360 
scaling, 27 
shifting, 27 
signal energy, 28 
signal power, 28 
sinusoidal, 83-84 
Signed integers, 253-260 
Significand, 267 
sigshift function, 27, 30 
sin function, 24-25 
sinc function, 92-94 
Sinusoidal sequence, 24-25, 32-33, 75 
discrete-time, 24-25, 32-33 
DTFT representation, 75 
frequency domain, response in, 75 
MATLAB signal representation, 24-25 
periodicity in frequency, 33 
periodicity in time, 33 
rectangular pulse, 35 
sampling, 32-33 
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Sinusoidal signals, 83-84, 604-605 
interference, suppression of, 604-605 
sampling, 83-84 

sm2oc function, 263, 270 

sm2tc function, 263, 272 

Soft zero, 267 

sos2tf function, 220 

Spectrum analyzers, 305 

spline function, 95-97 

Spread-spectrum digital data communication, 

634-636 

Stability, 40, 125-128 

bounded-input bounded-output (BIBO) 
stability, 40 

linear systems, 40 

zdomain causality and, 125-128 

stairs function, 94-95 

Statistical round-off noise, 565-576, 578-580 
fixed-point arithmetic analysis, 565-569 
floating-point arithmetic analysis, 578-580 
IIR digital filters, 565-576, 578-580 
MATLAB analysis for, 569-576 

StatModelR function, 548, 563 

std function, 548 

Steady-state response, 75-76, 130 

stem function, 48—49 

Stopband, 307 

sum function, 28 


Symmetric impulse response, 231, 310, 313-314 


Symmetry, 61, 68, 72-73, 168-173, 391 
circular conjugate, 168-173 
discrete Fourier series (DFS), 169 
discrete Fourier transform (DFT), 168-173 


discrete-time Fourier transform (DTFT), 61, 


68, 72-73 
mirror-image, 391 
periodic conjugate, 169 
Synthesis, discrete-time signals, 34-35 
System identification (modeling), 601-602 


T 


tc2sm function, 263, 272 

Ten’s complement number format, 258-260 
TensComplement function, 260 

tf2sos function, 219 
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Time, periodicity in, 33 
Time shifting, DTFT, 68, 70 
Time-invariant structures, FIR sampling rate 
conversion, 529-532 
Transformations, 425—445, 450-463 
analog-to-digital, 425—445 
bilinear, 426, 436-444 
frequency-band, 450-463 
IIR filter design, 425—445, 450-463 
impulse invariance, 426—436 
matched-z, 444-445 
Transient response, 130 
Transition band, 307 
Transposed structure, IIR filters, 217 
Truncation operation, 268-273, 547-548 
Twiddle factor, 192 
Two-sided sequence, 106-107 


Two’s complement number format, 253, 
256-258, 260, 262, 271-273 
TwosComplement function, 257—258 


U 


U_buttap function, 406—408, 410 
U_chb1ap function, 414-415 
U_chb2ap function, 419 
U_elipap function, 422-423 
Unbounded response, 130 

nit circle, 104 

nit impulse response, 59 

nit sample sequence, 23 


nit step sequence, 23—24 

nquantized filter coefficients, 284—285 
pfirdn function, 504-507, 522 
Upsampler, 488—490 


U 
U 
U 
Unit sample synthesis, 34 
U 
U 
u 


V 


VarGain function, 551-552 
Variables in MATLAB, 7-8 
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W zplane mapping, 450-456 
ztransform, 103-140, 146-148, 152-153 
bilateral, 103-107 


Wideband signals, 602-605 
Windowing, 324-346 


accumulated amplitude response, 326-328 
Bartlett window, 329 

Blackman window, 331-332, 338-340 
cutoff frequency, 324 

FIR filter design, 324-346 

frequency domain, 325-326 

Gibbs phenomenon, 328 

Hamming window, 330-331, 343-344 
Hann window, 330, 344-345 

Kaiser window, 331-334, 336-338, 340-342 
MATLAB implementation, 334-335 
rectangular window, 325-329 


sample delay, 324 
Word length, 261 


xX 


xcorr function, 47 


Z 


zdomain, 108, 118-128, 149-153 
causality, 125-128 
difference equation representation, 119-120 
differentiation in, 108 
discrete Fourier transforms in, 149-153 
DTFT interpolation formula for, 152-153 
MATLAB implementation, 120-125, 153 
reconstruction in, 152-153 
sampling in, 149-152 
stability, 125-128 
system functions 118-128 
system representations, relationships 

between, 125 

transfer function representation, 120 


z-transform reconstruction formula, 152-153 


complex conjugation, 107 
convolution, 108-110 
deconvolution, 109-110 
difference equation solutions using, 
128-134 
differentiation in zdomain, 108 
discrete Fourier series (DFS) relationship, 
146-148 
folding, 107 
frequency shifting, 107 
inversion of, 112-118 
linearity property, 107 
MATLAB implementation, 114-118, 
120-125, 131-134 
multiplication, 108 
one-sided, 128-130 
pairs, 110-111 
reconstruction formula, 152-153 
region of convergence (ROC), 104-107 
sample shifting, 107 
sequences, 103-107 
system representation in z-domain, 
118-128 
zdomain, 108, 118-128, 152-153 
Zero constellation, 317-318 
Zero locations, linear-phase FIR filters, 
317-323 
Zero-order-hold (ZOH) interpolation, 90-91, 
94-95 
Zero-padding, DFT operation, 159, 161-165 
Zero-state input and responses, 51-52, 
130-131 
zerophase function, 315-317 
zeros function, 23 
zmapping function, 453—458 
zplane function, 119, 121-122 
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